00000001:02000400:2.0F:1788746009.017208:0:2971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788746031.900188:0:3191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788746033.631117:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 415 MB/s 00000001:01000000:2.0:1788746033.889739:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 952 MB/s 00000001:01000000:3.0:1788746034.139440:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4719 MB/s 00000020:02000000:2.0:1788746035.162431:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g34d8757 00000400:02000000:0.0F:1788746036.279772:0:3298:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.124@tcp [8/256/0/180] 00008000:02000000:2.0:1788746040.222660:0:3447:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788746095.917392:0:5249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788746106.251342:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746106.251347:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788746106.251502:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000085cf451d 00000080:02000400:3.0:1788746106.251512:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788746106.262495:0:5830:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788746106.262509:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788746106.262547:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bc58450b) 00000020:00000080:3.0:1788746106.262569:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788746106.280688:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788746106.281387:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788746106.327754:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788746106.327795:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788746106.327816:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788746106.327885:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788746106.327911:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788746106.328273:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788746106.328281:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788746106.328293:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30960c 00000020:01000004:3.0:1788746106.328301:0:5830:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788746106.328305:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788746106.328310:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000085cf451d from MGS 00000020:01000004:3.0:1788746106.328314:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788746106.328323:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d8a046d3) 00000020:00000080:3.0:1788746106.328333:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788746106.328390:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000085cf451d from MGS, refs=2 00080000:01000000:3.0:1788746106.328395:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788746106.328430:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30961a 00000100:00100000:3.0:1788746106.328528:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788746106.328658:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788746106.328664:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788746106.336334:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788746106.336346:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788746106.337495:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746106.337669:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788746106.337682:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788746106.343020:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788746106.343031:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788746106.343591:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788746106.343599:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788746106.344540:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746106.344545:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746106.344546:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746106.344798:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746106.344808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746106.344810:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746106.345581:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788746106.354980:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788746106.594567:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2995 MB/s 00000001:01000000:2.0:1788746106.844502:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3155 MB/s 00000001:01000000:3.0:1788746107.099469:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 478 MB/s 00000001:01000000:3.0:1788746107.350449:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 613 MB/s 00080000:10000000:0.0:1788746107.371004:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788746107.388846:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788746107.401212:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788746107.401228:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788746107.401231:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788746107.405102:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788746107.405985:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788746107.406581:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788746107.407000:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788746107.407031:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788746107.408578:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746107.408916:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788746107.408923:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788746107.412365:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788746107.412381:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788746107.416115:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788746107.416133:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788746107.417875:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788746107.417896:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.124@tcp' 00000020:01000004:3.0:1788746107.417898:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788746107.417953:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.124@tcp (typ=mgc) 00000020:00000080:3.0:1788746107.417966:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.124@tcp (00000000cd4c9f8b) 00000020:00000080:3.0:1788746107.417985:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788746107.418084:0:5830:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000f74e4c4c@MGC192.168.206.124@tcp: add connection 192.168.206.124@tcp at head 00010000:00010000:3.0:1788746107.418240:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.124@tcp-0 is initialized 00000040:01000000:3.0:1788746107.418246:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788746107.421272:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788746107.421512:0:5846:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788746107.421576:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.124@tcp (uuid 85baee7e-e9e8-492f-b3b0-167696ca895f) 00000020:00000080:0.0:1788746107.421613:0:5830:0:(genops.c:1384:class_connect()) connect: client 85baee7e-e9e8-492f-b3b0-167696ca895f, cookie 0xe59b64da5b309628 00000100:00080000:0.0:1788746107.421628:0:5830:0:(import.c:545:import_select_connection()) MGC192.168.206.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788746107.421636:0:5830:0:(import.c:666:import_select_connection()) MGC192.168.206.124@tcp: import 00000000f74e4c4c using connection 192.168.206.124@tcp/0@lo 00000100:00100000:0.0:1788746107.421691:0:5830:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001bd0ea0c x1875636163444864/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746107.421722:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS 00000020:01000004:0.0:1788746107.421740:0:5830:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788746107.421745:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788746107.421765:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006b322678) 00000020:00000080:0.0:1788746107.421779:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788746107.424059:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bd0ea0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163444864:0@lo:250: 00000100:00100000:1.0:1788746107.429530:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746107.429648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163444864 00000100:00100000:1.0:1788746107.429660:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163444864 00000100:00100000:1.0:1788746107.429712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746107.429721:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a04e79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875636163444864:12345-0@lo:250: 00010000:00080000:1.0:1788746107.429752:0:5842:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 85baee7e-e9e8-492f-b3b0-167696ca895f@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1788746107.429782:0:5842:0:(genops.c:1384:class_connect()) connect: client 85baee7e-e9e8-492f-b3b0-167696ca895f, cookie 0xe59b64da5b309636 00000100:00080000:1.0:1788746107.429985:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000e9c8e871 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746107.430046:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a04e79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+5:3313:x1875636163444864:12345-0@lo:250: Request processed in 325us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746107.430055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746107.430108:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788746107.430119:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.124@tcp: connect to target with instance 0 00000100:00080000:1.0:1788746107.430128:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788746107.430132:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788746107.430136:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000f74e4c4c MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788746107.430138:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788746107.430142:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788746107.430147:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bd0ea0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163444864:0@lo:250: 00000100:00100000:1.0:1788746107.448208:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746107.448465:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788746107.448472:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788746107.449668:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788746107.449678:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788746107.450148:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788746107.450156:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788746107.451208:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746107.451383:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788746107.451388:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788746107.454130:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788746107.454142:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788746107.501841:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746107.502084:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788746107.502092:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788746107.503915:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788746107.503928:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788746107.504637:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746107.504960:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788746107.504966:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788746107.505498:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788746107.505504:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788746107.506106:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746107.506266:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788746107.506271:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788746107.508920:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788746107.508933:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788746107.510059:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746107.510252:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788746107.510258:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788746107.510985:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788746107.510992:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788746107.531617:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746107.531943:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788746107.531951:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788746107.533908:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788746107.533927:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788746107.534643:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788746107.534650:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788746107.536035:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788746107.536059:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788746107.536065:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788746107.536205:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788746107.536241:0:5830:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.124@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788746107.536246:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788746107.536248:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788746107.536250:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746107.536251:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746107.536252:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746107.536253:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746107.536255:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746107.536256:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788746107.536257:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746107.536258:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746107.536260:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746107.536261:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746107.536263:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788746107.536265:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746107.536267:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788746107.536267:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746107.536268:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746107.536269:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746107.536270:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746107.536271:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746107.536272:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788746107.536273:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746107.536274:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746107.536279:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746107.536280:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746107.536323:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788746107.536358:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f80c85df pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163444992:0@lo:253: 00000100:00100000:0.0:1788746107.536475:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.536602:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28e21ab going to sleep for 11 seconds 00000100:00100000:3.0:1788746107.538557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163444992 00000100:00100000:3.0:1788746107.538575:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163444992 00000100:00100000:3.0:1788746107.538643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746107.538653:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000998f0301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+5:5830:x1875636163444992:12345-0@lo:253: 20000000:01000000:3.0:1788746107.538731:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788746107.538735:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788746107.539469:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788746107.539569:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788746107.539879:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746107.541039:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788746107.541444:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788746107.541449:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788746107.541453:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788746107.541456:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788746107.541471:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788746107.541682:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746107.542053:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788746107.542066:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788746107.542120:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788746107.542172:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788746107.542210:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788746107.542783:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788746107.542806:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788746107.542874:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788746107.542881:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788746107.542910:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788746107.542917:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788746107.542942:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788746107.542987:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788746107.543027:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788746107.543033:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788746107.543046:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746107.543251:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788746107.543262:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788746107.543307:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788746107.543350:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788746107.543394:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788746107.543445:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788746107.543516:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788746107.543525:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788746107.543570:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788746107.543608:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788746107.543644:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788746107.543655:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788746107.543737:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788746107.543746:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788746107.543779:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788746107.543812:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788746107.543994:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788746107.544045:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788746107.544052:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788746107.544893:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788746107.546183:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788746107.546214:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.124@tcp for mdt 20000000:01000000:1.0:1788746107.546216:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.124@tcp (null) (null) (null) 00000040:00080000:1.0:1788746107.546253:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788746107.546261:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788746107.546291:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788746107.546297:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.124@tcp (null) (null) 00000040:00080000:1.0:1788746107.546342:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788746107.546352:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788746107.546382:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788746107.547977:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788746107.548102:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788746107.548105:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788746107.548109:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788746107.548120:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788746107.548123:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788746107.548152:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788746107.548154:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788746107.551387:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788746107.551995:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788746107.552058:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788746107.552095:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788746107.552107:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788746107.552110:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788746107.552753:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788746107.554945:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788746107.554993:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788746107.555105:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788746107.555126:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788746107.555128:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788746107.555133:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788746107.555135:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788746107.555140:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788746107.555146:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788746107.556765:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788746107.557540:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788746107.574079:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788746107.574134:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788746107.574211:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788746107.574234:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788746107.574256:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574275:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574285:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574292:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574314:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574320:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574326:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d4d87c97 already unused, calling callback (0000000042fb03fd) 00010000:00010000:0.0:1788746107.574329:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574336:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574350:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574358:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.574364:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4d87c97/0xe59b64da5b30963d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788746107.574380:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788746107.841880:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000998f0301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+5:5830:x1875636163444992:12345-0@lo:253: Request processed in 303222us (305398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746107.841903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746107.842086:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f80c85df pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163444992:0@lo:253: 10000000:01000000:2.0:1788746107.842103:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788746107.842106:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788746107.842108:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788746107.842110:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746107.842111:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788746107.842113:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746107.842114:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746107.842115:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788746107.842117:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788746107.842118:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788746107.842119:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746107.842120:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788746107.842149:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000085cf451d from lustre-MDT0000 10000000:01000000:2.0:1788746107.842173:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788746107.842187:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788746107.842192:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cd445093380 10000000:01000000:2.0:1788746107.842196:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788746107.842205:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cd445093380 from 1 10000000:01000000:2.0:1788746107.842207:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788746107.842261:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746107.842273:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746107.842282:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746107.842300:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c08f88ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445120:0@lo:101: 00000100:00100000:2.0:1788746107.842339:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746107.842430:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d937614 going to sleep for 11 seconds 00000100:00100000:3.0:1788746107.842495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445120 00000100:00100000:3.0:1788746107.842503:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445120 00000100:00100000:3.0:1788746107.842552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746107.842561:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001274e891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:5830:x1875636163445120:12345-0@lo:101: 00010000:00010000:3.0:1788746107.842574:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746107.842588:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018f442ab/0xe59b64da5b30964b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.842614:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018f442ab/0xe59b64da5b30964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309644 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.842625:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018f442ab/0xe59b64da5b30964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309644 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.842634:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018f442ab, rc 0) 00000100:00100000:3.0:1788746107.842667:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001274e891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5830:x1875636163445120:12345-0@lo:101: Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746107.842674:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746107.842877:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c08f88ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445120:0@lo:101: 00010000:00010000:0.0:1788746107.842892:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.842912:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746107.842959:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445248:0@lo:501: 00000100:00100000:0.0:1788746107.842987:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.843018:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000458fb6f0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746107.843079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445248 00000100:00100000:2.0:1788746107.843084:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445248 00000100:00100000:2.0:1788746107.843125:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788746107.843131:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3be61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5830:x1875636163445248:12345-0@lo:501: 00000100:00100000:2.0:1788746107.843375:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3be61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5830:x1875636163445248:12345-0@lo:501: Request processed in 245us (388us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746107.843383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746107.843517:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445248:0@lo:501: 10000000:01000000:0.0:1788746107.843541:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788746107.843560:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.843569:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 0000000089dea997/0xe59b64da5b309644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746107.843576:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd448caf000 10000000:01000000:0.0:1788746107.843580:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788746107.843584:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cd448caf000 10000000:01000000:0.0:1788746107.843586:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788746107.843587:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cd448caf000 from 1 10000000:01000000:0.0:1788746107.843589:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788746107.843609:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.843615:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.843621:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746107.843643:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445376:0@lo:101: 00000100:00100000:0.0:1788746107.843671:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.843701:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000458fb6f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746107.843753:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445376 00000100:00100000:3.0:1788746107.843758:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445376 00000100:00100000:3.0:1788746107.843798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746107.843806:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc333a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5830:x1875636163445376:12345-0@lo:101: 00010000:00010000:3.0:1788746107.843833:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746107.843843:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008184036c/0xe59b64da5b309659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309652 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.843858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008184036c/0xe59b64da5b309659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309652 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.843867:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008184036c/0xe59b64da5b309659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309652 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.843873:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008184036c, rc 0) 00000100:00100000:3.0:1788746107.843902:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc333a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+7:5830:x1875636163445376:12345-0@lo:101: Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746107.843909:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746107.844108:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445376:0@lo:101: 00010000:00010000:0.0:1788746107.844119:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.844126:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746107.844138:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788746107.844152:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.844159:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 00000000d4d87c97/0xe59b64da5b309652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746107.844165:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788746107.844168:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746107.844172:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cd448caf000 10000000:01000000:0.0:1788746107.844174:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788746107.844177:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788746107.844179:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788746107.844192:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.844199:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.844216:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746107.844228:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445504:0@lo:101: 00000100:00100000:0.0:1788746107.844253:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.844274:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000458fb6f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746107.844364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445504 00000100:00100000:3.0:1788746107.844368:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445504 00000100:00100000:3.0:1788746107.844425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746107.844432:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000122f278f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+7:5830:x1875636163445504:12345-0@lo:101: 00010000:00010000:3.0:1788746107.844439:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746107.844446:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003811a690/0xe59b64da5b309667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.844460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003811a690/0xe59b64da5b309667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309660 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.844467:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003811a690/0xe59b64da5b309667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309660 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746107.844473:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003811a690, rc 0) 00000100:00100000:3.0:1788746107.844505:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000122f278f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+8:5830:x1875636163445504:12345-0@lo:101: Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746107.844511:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746107.844616:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445504:0@lo:101: 00010000:00010000:0.0:1788746107.844627:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746107.844633:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746107.844673:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445632:0@lo:501: 00000100:00100000:0.0:1788746107.844696:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.844727:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000458fb6f0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746107.844776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445632 00000100:00100000:2.0:1788746107.844781:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445632 00000100:00100000:2.0:1788746107.844829:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746107.844836:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d11b908e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+8:5830:x1875636163445632:12345-0@lo:501: 00000100:00100000:2.0:1788746107.845061:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d11b908e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5830:x1875636163445632:12345-0@lo:501: Request processed in 226us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746107.845075:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788746107.845217:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445632:0@lo:501: 00000100:00100000:0.0:1788746107.845246:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445760:0@lo:503: 00000100:00100000:0.0:1788746107.845285:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746107.845309:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000458fb6f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746107.845367:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445760 00000100:00100000:3.0:1788746107.845371:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445760 00000100:00100000:3.0:1788746107.845425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746107.845432:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b00a0f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5830:x1875636163445760:12345-0@lo:503: 00000100:00100000:3.0:1788746107.845578:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b00a0f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5830:x1875636163445760:12345-0@lo:503: Request processed in 147us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746107.845585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746107.845669:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000984ee7c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163445760:0@lo:503: 00000100:00100000:3.0:1788746107.846076:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054da55ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5872:1875636163445888:0@lo:502: 00000100:00100000:3.0:1788746107.846113:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746107.846144:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073929d43 going to sleep for 11 seconds 00000100:00100000:0.0:1788746107.846191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163445888 00000100:00100000:0.0:1788746107.846196:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163445888 00000100:00100000:0.0:1788746107.846220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746107.846227:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf79cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5872:x1875636163445888:12345-0@lo:502: 00000100:00100000:0.0:1788746107.846384:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf79cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5872:x1875636163445888:12345-0@lo:502: Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746107.846392:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746107.846534:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054da55ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5872:1875636163445888:0@lo:502: 00000020:01000000:3.0:1788746107.846557:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746107.846568:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746107.846571:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788746107.846576:0:5872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788746107.846579:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746107.846592:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000789bea0c) 00000020:00000080:3.0:1788746107.846609:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788746107.846614:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788746107.846690:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788746107.846696:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b309675 00000020:00000080:3.0:1788746107.847028:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788746107.847033:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746107.847037:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746107.847039:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788746107.847041:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746107.847051:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746107.847053:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788746107.847056:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746107.847069:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000de56c24f) 00000020:00000080:3.0:1788746107.847079:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788746107.847084:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788746107.847086:0:5872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788746107.847089:0:5872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788746107.847096:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788746107.847138:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000085cf451d from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788746107.847150:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cace6810) 00000020:00000080:3.0:1788746107.847157:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788746107.847203:0:5872:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788746107.847207:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30968a 00000020:00000080:3.0:1788746107.847312:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788746107.847319:0:5872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788746107.847324:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe59b64da5b309691 00080000:01000000:3.0:1788746107.847330:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788746107.847333:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b309698 00080000:10000000:2.0:1788746107.848373:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788746107.848710:0:5872:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788746107.858927:0:5872:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788746107.961633:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788746107.962309:0:5872:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788746107.967724:0:5872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788746107.968247:0:5872:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788746108.018530:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004b69599d) 00000020:00000080:3.0:1788746108.018552:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788746108.018628:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788746108.018635:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b3096a6 00000020:00000080:3.0:1788746108.018858:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788746108.020178:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788746108.076951:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788746108.105367:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788746108.133571:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746108.173678:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788746108.216557:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788746108.252342:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe59b64da5b3096ad 00000020:00000080:2.0:1788746108.253261:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788746108.253273:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746108.253279:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746108.253281:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788746108.253284:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746108.253289:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746108.253290:0:5872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788746108.253293:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788746108.253295:0:5872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788746108.253297:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746108.253300:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746108.253301:0:5872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788746108.253303:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746108.253307:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746108.253308:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788746108.253311:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788746108.253346:0:5872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788746108.253522:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f2c3caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5872:1875636163446016:0@lo:502: 00000100:00100000:2.0:1788746108.253601:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746108.253700:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0d2e92f going to sleep for 11 seconds 00000100:00100000:0.0:1788746108.253919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446016 00000100:00100000:0.0:1788746108.253928:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446016 00000100:00100000:0.0:1788746108.254029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788746108.254039:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083f1a62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5872:x1875636163446016:12345-0@lo:502: 00000100:00100000:0.0:1788746108.254611:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083f1a62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5872:x1875636163446016:12345-0@lo:502: Request processed in 573us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746108.254620:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746108.254721:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f2c3caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5872:1875636163446016:0@lo:502: 00000020:01000000:3.0:1788746108.254763:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746108.254770:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746108.254773:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788746108.254778:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788746108.255033:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788746108.255050:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788746108.255077:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.255089:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 0000000036c34fbe/0xe59b64da5b309660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746108.255097:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448caf000 from 1 10000000:01000000:1.0:1788746108.255100:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746108.255147:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.255155:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.255163:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.255180:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446144:0@lo:101: 00000100:00100000:1.0:1788746108.255217:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.255771:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:2.0:1788746108.255964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446144 00000100:00100000:2.0:1788746108.255980:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446144 00000100:00100000:2.0:1788746108.256026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746108.256034:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4fb4aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+9:5830:x1875636163446144:12345-0@lo:101: 00010000:00010000:2.0:1788746108.256046:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746108.256064:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3096b4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.256205:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.256215:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.256224:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dea527d7, rc 0) 00000100:00100000:2.0:1788746108.256276:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4fb4aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+10:5830:x1875636163446144:12345-0@lo:101: Request processed in 243us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746108.256283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746108.256386:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446144:0@lo:101: 00010000:00010000:1.0:1788746108.256418:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.256427:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.257263:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446272:0@lo:256: 00000100:00100000:1.0:1788746108.257317:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.257436:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:0.0:1788746108.257513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446272 00000100:00100000:0.0:1788746108.257521:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446272 00000100:00100000:3.0:1788746108.257963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788746108.257974:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de6d8f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+10:5830:x1875636163446272:12345-0@lo:256: 20000000:01000000:3.0:1788746108.258015:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788746108.258021:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788746108.258326:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de6d8f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+10:5830:x1875636163446272:12345-0@lo:256: Request processed in 354us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746108.258335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746108.258427:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446272:0@lo:256: 10000000:01000000:1.0:1788746108.259037:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746108.259056:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.259312:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746108.259324:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448caf000 from 1 10000000:01000000:1.0:1788746108.259327:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746108.259366:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.259373:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.259382:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.259440:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446400:0@lo:101: 00000100:00100000:1.0:1788746108.259490:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.259833:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:2.0:1788746108.259964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446400 00000100:00100000:2.0:1788746108.259972:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446400 00000100:00100000:2.0:1788746108.260022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746108.260031:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000007e22f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+10:5830:x1875636163446400:12345-0@lo:101: 00010000:00010000:2.0:1788746108.260043:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746108.260057:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3096c2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.260093:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.260104:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.260124:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4c45cee, rc 0) 00000100:00100000:2.0:1788746108.260172:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000007e22f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446400:12345-0@lo:101: Request processed in 141us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746108.260178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746108.260382:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446400:0@lo:101: 00010000:00010000:1.0:1788746108.260421:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.260431:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.260489:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446528:0@lo:501: 00000100:00100000:1.0:1788746108.260517:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.260529:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:2.0:1788746108.260586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446528 00000100:00100000:2.0:1788746108.260590:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446528 00000100:00100000:2.0:1788746108.260608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788746108.260613:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce621141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446528:12345-0@lo:501: 00000100:00100000:2.0:1788746108.261690:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce621141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446528:12345-0@lo:501: Request processed in 1073us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746108.261703:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746108.262204:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446528:0@lo:501: 00000100:00100000:1.0:1788746108.262254:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446656:0@lo:503: 00000100:00100000:1.0:1788746108.262305:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.262343:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:2.0:1788746108.262423:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446656 00000100:00100000:2.0:1788746108.262431:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446656 00000100:00100000:2.0:1788746108.262465:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788746108.262473:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005abadcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446656:12345-0@lo:503: 00000040:00080000:2.0:1788746108.262514:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746108.262657:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005abadcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446656:12345-0@lo:503: Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746108.262666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746108.262918:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446656:0@lo:503: 00000040:00080000:2.0:1788746108.264356:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788746108.264573:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788746108.264594:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746108.264618:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.264630:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746108.264683:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788746108.264686:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd448caf000 10000000:01000000:1.0:1788746108.264689:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd448caf000 10000000:01000000:1.0:1788746108.264693:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788746108.264699:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448caf000 from 1 10000000:01000000:1.0:1788746108.264702:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788746108.264918:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.264929:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.264941:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.264963:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446784:0@lo:101: 00000100:00100000:1.0:1788746108.265247:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.265353:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aaf16136 going to sleep for 11 seconds 00000100:00100000:0.0:1788746108.265549:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446784 00000100:00100000:0.0:1788746108.265558:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446784 00000100:00100000:2.0:1788746108.265709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746108.265719:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d8323a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163446784:12345-0@lo:101: 00010000:00010000:2.0:1788746108.265744:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746108.265758:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000449523ef/0xe59b64da5b3096d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3096d0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.265901:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000449523ef/0xe59b64da5b3096d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.265914:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000449523ef/0xe59b64da5b3096d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746108.265923:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000449523ef, rc 0) 00000100:00100000:2.0:1788746108.266160:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d8323a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163446784:12345-0@lo:101: Request processed in 441us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746108.266168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746108.266342:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446784:0@lo:101: 00010000:00010000:1.0:1788746108.266361:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.266371:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.266489:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446912:0@lo:501: 00000100:00100000:1.0:1788746108.266527:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.266571:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aaf16136 going to sleep for 11 seconds 00000100:00100000:3.0:1788746108.266650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163446912 00000100:00100000:3.0:1788746108.266657:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163446912 00000100:00100000:3.0:1788746108.266876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746108.266885:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c9f38da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163446912:12345-0@lo:501: 00000100:00100000:3.0:1788746108.267317:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c9f38da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163446912:12345-0@lo:501: Request processed in 433us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746108.267325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746108.267511:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163446912:0@lo:501: 00000100:00100000:1.0:1788746108.267554:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163447040:0@lo:503: 00000100:00100000:1.0:1788746108.267597:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.267626:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aaf16136 going to sleep for 11 seconds 00000100:00100000:3.0:1788746108.267673:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447040 00000100:00100000:3.0:1788746108.267678:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447040 00000100:00100000:3.0:1788746108.267748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746108.267756:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b94eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163447040:12345-0@lo:503: 00000100:00100000:3.0:1788746108.268366:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b94eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163447040:12345-0@lo:503: Request processed in 610us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746108.268375:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746108.268486:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163447040:0@lo:503: 00000100:00100000:2.0:1788746108.269006:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e833d9b8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5877:1875636163447168:0@lo:502: 00000100:00100000:2.0:1788746108.269056:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746108.269216:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28e21ab going to sleep for 11 seconds 00000100:00100000:1.0:1788746108.269271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447168 00000100:00100000:1.0:1788746108.269279:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447168 00000100:00100000:1.0:1788746108.269308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746108.269316:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063d01aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5877:x1875636163447168:12345-0@lo:502: 00000100:00100000:1.0:1788746108.269575:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063d01aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5877:x1875636163447168:12345-0@lo:502: Request processed in 260us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746108.269584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788746108.269694:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e833d9b8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5877:1875636163447168:0@lo:502: 00000020:01000004:2.0:1788746108.269761:0:5877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788746108.269787:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000026c3da91) 00000020:00000080:2.0:1788746108.269949:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788746108.270168:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000085cf451d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788746108.270172:0:5877:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000085cf451d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788746108.270175:0:5877:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000085cf451d 4 00010000:00080000:2.0:1788746108.270205:0:5877:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000fa86acec@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:2.0:1788746108.273233:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788746108.273548:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788746108.273589:0:5877:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788746108.273602:0:5877:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe59b64da5b3096e5 00000100:00080000:2.0:1788746108.273614:0:5877:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746108.273625:0:5877:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fa86acec using connection 192.168.206.124@tcp/0@lo 00000100:00100000:2.0:1788746108.273687:0:5877:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e833d9b8 x1875636163447296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746108.273761:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e833d9b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163447296:0@lo:38: 00000100:00100000:0.0:1788746108.273851:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788746108.274262:0:5877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788746108.278583:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5877:1875636163447424:0@lo:502: 00000100:00100000:1.0:1788746108.278664:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.278704:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d09f23b going to sleep for 11 seconds 00000100:00100000:1.0:1788746108.278725:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447424 00000100:00100000:1.0:1788746108.278744:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447424 00000100:00100000:1.0:1788746108.278878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788746108.278889:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005990ef88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5877:x1875636163447424:12345-0@lo:502: 00000100:00100000:1.0:1788746108.279295:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005990ef88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5877:x1875636163447424:12345-0@lo:502: Request processed in 407us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746108.279304:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788746108.279366:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:5877:1875636163447424:0@lo:502: 00000040:00080000:1.0:1788746108.279431:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788746108.279546:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788746108.279572:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788746108.279589:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.279600:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 000000003e24ea7e/0xe59b64da5b3096d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788746108.279653:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788746108.279656:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788746108.279657:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746108.279658:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746108.279659:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746108.279661:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746108.279662:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746108.279663:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788746108.279664:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746108.279665:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746108.279667:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746108.279668:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746108.279671:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788746108.279674:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746108.279677:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788746108.279678:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746108.279679:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746108.279680:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746108.279681:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746108.279682:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746108.279683:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788746108.279684:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746108.279685:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746108.279686:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746108.279687:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746108.279703:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788746108.279714:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163447552:0@lo:253: 00000100:00100000:1.0:1788746108.279760:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.279780:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2d0099e going to sleep for 11 seconds 00000100:00100000:0.0:1788746108.281055:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447296 00000100:00100000:0.0:1788746108.281193:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447296 00000100:00100000:0.0:1788746108.281245:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746108.281251:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000984ee7c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163447296:12345-0@lo:38: 00000100:00100000:0.0:1788746108.281334:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000984ee7c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163447296:12345-0@lo:38: Request processed in 82us (7483us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788746108.281341:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746108.281378:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746108.281394:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000fa86acec lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746108.281421:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788746108.281425:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e833d9b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163447296:0@lo:38: 00000100:00100000:1.0:1788746108.281549:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447552 00000100:00100000:1.0:1788746108.281559:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447552 00000100:00100000:1.0:1788746108.281597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788746108.281603:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b1586e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5830:x1875636163447552:12345-0@lo:253: 20000000:01000000:1.0:1788746108.281639:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788746108.281653:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788746108.331892:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788746108.331948:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788746108.335186:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788746108.335196:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788746108.335220:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.335241:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.335250:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.335300:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746108.335316:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 12 pid: 5844 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.335330:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9c9950d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163447680:0@lo:104: 00000100:00100000:1.0:1788746108.335422:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746108.335474:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b6acdf3 going to sleep for 11 seconds 00000100:00100000:3.0:1788746108.335556:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447680 00000100:00100000:3.0:1788746108.335567:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447680 00000100:00100000:3.0:1788746108.335626:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746108.335636:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002506b833 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163447680:12345-0@lo:104: 00010000:00010000:3.0:1788746108.335650:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335715:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746108.335744:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002506b833 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163447680:12345-0@lo:104: Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746108.335753:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788746108.335778:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746108.335784:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335803:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c052fa87 already unused, calling callback (00000000ad965bdf) 10000000:00010000:3.0:1788746108.335806:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335813:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746108.335829:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746108.335835:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746108.335866:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335872:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746108.335890:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335897:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: 00000000c052fa87/0xe59b64da5b3096b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.335913:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746108.335915:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746108.335916:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746108.335983:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054da55ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163447808:0@lo:103: 00000100:00100000:3.0:1788746108.336145:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746108.336214:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447808 00000100:00100000:3.0:1788746108.336219:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447808 00010000:00010000:3.0:1788746108.336234:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 13 pid: 5844 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746108.336256:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746108.336263:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080ae1a2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3315:x1875636163447808:12345-0@lo:103: 00010000:00010000:3.0:1788746108.336273:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746108.336278:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 13 pid: 5844 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336287:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 13 pid: 5844 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336303:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336310:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788746108.336322:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001127898s 00010000:00010000:3.0:1788746108.336326:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336332:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336338:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336354:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336359:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f19492a2 already unused, calling callback (0000000042fb03fd) 00010000:00010000:3.0:1788746108.336363:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336369:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336377:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336386:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746108.336451:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080ae1a2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3315:x1875636163447808:12345-0@lo:103: Request processed in 189us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746108.336458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746108.336505:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054da55ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163447808:0@lo:103: 00010000:00010000:3.0:1788746108.336532:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dea527d7/0xe59b64da5b3096bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3096b4 expref: 12 pid: 5844 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746108.336541:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9c9950d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163447680:0@lo:104: 00010000:00010000:3.0:1788746108.336551:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336558:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336563:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746108.336574:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f19492a2/0xe59b64da5b3096ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746108.343335:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b1586e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5830:x1875636163447552:12345-0@lo:253: Request processed in 61724us (63567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746108.343351:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788746108.344325:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007943db8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:5830:1875636163447552:0@lo:253: 10000000:01000000:2.0:1788746108.344347:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788746108.344350:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788746108.344353:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788746108.344354:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746108.344355:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746108.344356:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746108.344358:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746108.344359:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788746108.344360:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788746108.344362:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788746108.344363:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788746108.344364:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746108.344366:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788746108.344387:0:5830:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788746108.349959:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788746108.350348:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788746108.350578:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788746108.350730:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788746108.350938:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788746108.351102:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746108.352891:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746108.353075:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746108.353284:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746108.353456:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746108.353623:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746108.353782:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788746108.399516:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1788746108.410487:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788746108.435260:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788746108.435551:0:5883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788746108.438268:0:5882:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788746108.438275:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788746108.439743:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788746108.439941:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788746108.441297:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788746108.441314:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788746108.441588:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746108.446877:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788746108.447540:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788746108.447575:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788746108.447864:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788746108.448545:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788746108.450373:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788746108.450557:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788746108.450848:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788746108.451297:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788746108.451810:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788746108.452198:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788746108.452357:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788746108.453343:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788746108.453542:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788746108.453759:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788746108.454886:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788746108.455306:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788746108.455489:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788746108.455646:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788746108.455836:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788746108.458419:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788746108.458946:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788746108.459389:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788746108.459564:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788746108.459730:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788746108.460165:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788746108.460354:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788746108.460721:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788746108.460911:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788746108.461224:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788746108.461384:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788746108.461545:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788746108.461697:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788746108.461850:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788746108.462243:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788746108.462447:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788746108.462602:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788746108.462921:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788746108.511487:0:5883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788746108.574173:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788746108.574210:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb85481cd3988 00100000:10000000:3.0:1788746108.574218:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788746108.581674:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788746108.581693:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788746108.581706:0:5830:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788746108.581735:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788746108.638732:0:5883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788746108.639235:0:5883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788746108.639239:0:5883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788746109.434857:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746110.458547:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746111.483215:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746112.507074:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746113.466537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788746113.466546:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788746113.466549:0:8:0:(import.c:65:import_set_state_nolock()) 00000000fa86acec lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746113.466565:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fa86acec using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746113.466585:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000055a22e43 x1875636163448064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746113.466648:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163448064:0@lo:38: 00000100:00100000:0.0:1788746113.466780:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0576f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163447936:0@lo:400: 00000100:00100000:1.0:1788746113.468488:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746113.468602:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448064 00000100:00100000:1.0:1788746113.468612:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448064 00000100:00100000:1.0:1788746113.468649:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746113.468655:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000481498e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875636163448064:12345-0@lo:38: 00010000:00080000:1.0:1788746113.468686:0:5851:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788746113.468725:0:5851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe59b64da5b3096f3 00000004:00100000:1.0:1788746113.468806:0:5851:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788746113.468958:0:5851:0:(import.c:65:import_set_state_nolock()) 0000000090b68def : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746113.469025:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000481498e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875636163448064:12345-0@lo:38: Request processed in 368us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746113.469032:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788746113.469081:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000055a22e43 x1875636163448064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746113.469097:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788746113.469106:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788746113.469111:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788746113.469113:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000fa86acec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788746113.469118:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163448064:0@lo:38: 00000100:00100000:0.0:1788746113.469207:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746113.470239:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163447936 00000100:00100000:1.0:1788746113.470249:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163447936 00000100:00100000:1.0:1788746113.470351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788746113.470361:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca3383d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3316:x1875636163447936:12345-0@lo:400: 00000100:00100000:1.0:1788746113.470446:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca3383d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3316:x1875636163447936:12345-0@lo:400: Request processed in 87us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746113.470453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788746113.470497:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0576f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163447936:0@lo:400: 00010000:00010000:3.0:1788746113.530489:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746113.970825:0:6126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788746113.984897:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746113.984904:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448caf000 from 3 10000000:01000000:0.0:1788746113.984909:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746113.984952:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746113.984964:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746113.984974:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746113.984997:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004ffd708 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448192:0@lo:101: 00000100:00100000:0.0:1788746113.985058:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746113.985103:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f091d9c going to sleep for 11 seconds 00000100:00100000:1.0:1788746113.985173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448192 00000100:00100000:1.0:1788746113.985181:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448192 00000100:00100000:1.0:1788746113.985234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788746113.985242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bb3b515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5846:x1875636163448192:12345-0@lo:101: 00010000:00010000:1.0:1788746113.985254:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746113.985266:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040731cf1/0xe59b64da5b309701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3096fa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746113.985287:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040731cf1/0xe59b64da5b309701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746113.985297:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040731cf1/0xe59b64da5b309701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746113.985305:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040731cf1, rc 0) 00000100:00100000:1.0:1788746113.985343:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bb3b515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163448192:12345-0@lo:101: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746113.985349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746113.985558:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004ffd708 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448192:0@lo:101: 00010000:00010000:0.0:1788746113.985571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746113.985589:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746113.985635:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004ffd708 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448320:0@lo:256: 00000100:00100000:0.0:1788746113.985666:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746113.985691:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f091d9c going to sleep for 11 seconds 00000100:00100000:1.0:1788746113.986701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448320 00000100:00100000:1.0:1788746113.986710:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448320 00000100:00100000:1.0:1788746113.986754:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746113.986842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000462adc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163448320:12345-0@lo:256: 20000000:01000000:1.0:1788746113.986867:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746113.986880:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746113.986883:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788746113.986976:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000462adc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163448320:12345-0@lo:256: Request processed in 137us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746113.986983:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746113.987704:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004ffd708 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448320:0@lo:256: 10000000:01000000:1.0:1788746113.987812:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746113.987820:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746113.987829:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: 0000000079e47a40/0xe59b64da5b3096fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746114.554493:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746115.592771:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746116.602635:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746117.629921:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746118.586697:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8196e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163448448:0@lo:400: 00000100:00100000:0.0:1788746118.586786:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746118.586891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448448 00000100:00100000:2.0:1788746118.586910:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448448 00000100:00100000:2.0:1788746118.586968:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788746118.586977:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9cc261f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3317:x1875636163448448:12345-0@lo:400: 00000100:00100000:2.0:1788746118.587025:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9cc261f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3317:x1875636163448448:12345-0@lo:400: Request processed in 50us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746118.587032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746118.587223:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746118.587234:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d91fb43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163448576:0@lo:400: 00000100:00100000:3.0:1788746118.587271:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746118.587441:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8196e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163448448:0@lo:400: 00000100:00100000:2.0:1788746118.587533:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448576 00000100:00100000:2.0:1788746118.587538:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448576 00000100:00100000:2.0:1788746118.587572:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746118.587578:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054da55ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163448576:12345-0@lo:400: 00000100:00100000:2.0:1788746118.587613:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054da55ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163448576:12345-0@lo:400: Request processed in 35us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746118.587619:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788746118.588198:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001d91fb43 x1875636163448576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746118.588211:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d91fb43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163448576:0@lo:400: 00010000:00010000:3.0:1788746118.656988:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788746118.838337:0:6327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb0281140 20000000:00000080:3.0:1788746118.838354:0:6327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd44567d000 uarg=0000000000000000 20000000:01000000:3.0:1788746118.838385:0:6327:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788746118.838392:0:6327:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788746118.838431:0:6327:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788746118.838710:0:6327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788746118.838722:0:6327:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788746118.853268:0:6327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746118.855448:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788746118.855521:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788746118.855563:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788746118.855579:0:6327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746118.855715:0:6327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.855806:0:6327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.855815:0:6327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.855848:0:6327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.855876:0:6327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 11 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746118.855888:0:6327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae5fff93 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6327:1875636163448704:0@lo:104: 00000100:00100000:2.0:1788746118.856113:0:6327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746118.856243:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448704 00000100:00100000:1.0:1788746118.856251:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448704 00000100:00100000:1.0:1788746118.856298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746118.856304:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d3e37bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:6327:x1875636163448704:12345-0@lo:104: 00010000:00010000:1.0:1788746118.856315:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746118.856353:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746118.856357:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d3e37bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:6327:x1875636163448704:12345-0@lo:104: Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746118.856363:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746118.857097:0:6327:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de272338 going to sleep for 11 seconds 00000100:00100000:2.0:1788746118.857130:0:6327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae5fff93 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6327:1875636163448704:0@lo:104: 00010000:00010000:2.0:1788746118.857150:0:6327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860511:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746118.860523:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860534:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e525a0e4 already unused, calling callback (00000000ad965bdf) 10000000:00010000:0.0:1788746118.860537:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860545:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746118.860552:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746118.860557:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788746118.860667:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860690:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746118.860726:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860740:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: 00000000e525a0e4/0xe59b64da5b3096c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.860775:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746118.860777:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746118.860779:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746118.861845:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746118.861869:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cf02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163448832:0@lo:103: 00000100:00100000:2.0:1788746118.861931:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746118.862331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448832 00000100:00100000:0.0:1788746118.862340:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448832 00010000:00010000:0.0:1788746118.862370:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 12 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746118.862419:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746118.862426:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5fff93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3314:x1875636163448832:12345-0@lo:103: 00010000:00010000:0.0:1788746118.862438:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746118.862441:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 12 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862452:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 12 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862465:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4c45cee/0xe59b64da5b3096c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3096c2 expref: 12 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862478:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862500:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862514:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862520:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862525:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862530:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862535:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ae1ec3c already unused, calling callback (0000000042fb03fd) 00010000:00010000:0.0:1788746118.862538:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862544:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862563:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746118.862573:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746118.862623:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5fff93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3314:x1875636163448832:12345-0@lo:103: Request processed in 197us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746118.862629:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746118.862667:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cf02d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163448832:0@lo:103: 00010000:00010000:2.0:1788746118.863008:0:6327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.863018:0:6327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746118.863023:0:6327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ae1ec3c/0xe59b64da5b309708 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746119.676290:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746120.698595:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746121.723307:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788746121.787458:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746121.787466:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448caf000 from 1 10000000:01000000:1.0:1788746121.787471:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746121.787513:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: 000000009836e4b3/0xe59b64da5b30970f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746121.787524:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: 000000009836e4b3/0xe59b64da5b30970f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746121.787533:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: 000000009836e4b3/0xe59b64da5b30970f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746121.787555:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448960:0@lo:101: 00000100:00100000:1.0:1788746121.787622:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746121.787665:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037563f16 going to sleep for 11 seconds 00000100:00100000:0.0:1788746121.788182:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163448960 00000100:00100000:0.0:1788746121.788190:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163448960 00000100:00100000:0.0:1788746121.788235:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788746121.788242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5c6c412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:5846:x1875636163448960:12345-0@lo:101: 00010000:00010000:0.0:1788746121.788254:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746121.788266:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046ccd6fc/0xe59b64da5b309716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30970f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746121.788286:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046ccd6fc/0xe59b64da5b309716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30970f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746121.788295:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046ccd6fc/0xe59b64da5b309716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30970f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746121.788302:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046ccd6fc, rc 0) 00000100:00100000:0.0:1788746121.788342:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5c6c412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163448960:12345-0@lo:101: Request processed in 100us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746121.788349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746121.790950:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163448960:0@lo:101: 00010000:00010000:1.0:1788746121.790973:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: 000000009836e4b3/0xe59b64da5b30970f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746121.790984:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: 000000009836e4b3/0xe59b64da5b30970f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746121.791051:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163449088:0@lo:501: 00000100:00100000:1.0:1788746121.791114:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746121.791155:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037563f16 going to sleep for 11 seconds 00000100:00100000:0.0:1788746121.791264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449088 00000100:00100000:0.0:1788746121.791270:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449088 00000100:00100000:0.0:1788746121.791318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746121.791325:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f38631a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163449088:12345-0@lo:501: 00000100:00100000:0.0:1788746121.791536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f38631a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163449088:12345-0@lo:501: Request processed in 212us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746121.791543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788746121.792980:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055a22e43 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163449088:0@lo:501: 00000100:00100000:2.0:1788746121.793038:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc34d273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163449216:0@lo:503: 00000100:00100000:2.0:1788746121.793096:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746121.793175:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b69db9c going to sleep for 11 seconds 00000100:00100000:0.0:1788746121.799309:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449216 00000100:00100000:0.0:1788746121.799323:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449216 00000100:00100000:0.0:1788746121.799378:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746121.799386:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c54bbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163449216:12345-0@lo:503: 00000100:00100000:0.0:1788746121.799647:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c54bbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163449216:12345-0@lo:503: Request processed in 262us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746121.799655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746121.799737:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc34d273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163449216:0@lo:503: 00000100:00100000:3.0:1788746121.800732:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007b7799d pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6524:1875636163449344:0@lo:502: 00000100:00100000:3.0:1788746121.800801:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746121.800838:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4ff3cf1 going to sleep for 11 seconds 00000100:00100000:0.0:1788746121.800937:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449344 00000100:00100000:0.0:1788746121.800943:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449344 00000100:00100000:0.0:1788746121.800972:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746121.800978:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c121a2ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6524:x1875636163449344:12345-0@lo:502: 00000100:00100000:0.0:1788746121.801137:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c121a2ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6524:x1875636163449344:12345-0@lo:502: Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746121.801144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788746121.801466:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007b7799d pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6524:1875636163449344:0@lo:502: 00000020:01000000:3.0:1788746121.801491:0:6524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746121.801501:0:6524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746121.801503:0:6524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788746121.801510:0:6524:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448caf000 00000020:00000080:3.0:1788746121.801512:0:6524:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788746121.801552:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6524:1875636163449472:0@lo:502: 00000100:00100000:3.0:1788746121.801588:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746121.801602:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746121.801698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449472 00000100:00100000:0.0:1788746121.801703:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449472 00000100:00100000:0.0:1788746121.801752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788746121.801760:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6524:x1875636163449472:12345-0@lo:502: 00000100:00100000:0.0:1788746121.801901:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6524:x1875636163449472:12345-0@lo:502: Request processed in 141us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746121.801909:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788746121.802029:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6524:1875636163449472:0@lo:502: 00000020:01000000:3.0:1788746121.802049:0:6524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746121.802053:0:6524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746121.802055:0:6524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788746121.802059:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788746121.802205:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788746121.802226:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746121.802235:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746121.802246:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746122.749872:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746123.706642:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163449600:0@lo:400: 00000100:00100000:3.0:1788746123.706718:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746123.706779:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746123.706785:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163449728:0@lo:400: 00000100:00100000:3.0:1788746123.706809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746123.707010:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449600 00000100:00100000:2.0:1788746123.707024:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449600 00000100:00100000:2.0:1788746123.707095:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788746123.707104:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3316:x1875636163449600:12345-0@lo:400: 00000100:00100000:2.0:1788746123.707156:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3316:x1875636163449600:12345-0@lo:400: Request processed in 53us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746123.707163:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788746123.707249:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163449600:0@lo:400: 00000100:00100000:1.0:1788746123.707382:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449728 00000100:00100000:1.0:1788746123.707420:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449728 00000100:00100000:1.0:1788746123.707451:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746123.707458:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163449728:12345-0@lo:400: 00000100:00100000:1.0:1788746123.707501:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163449728:12345-0@lo:400: Request processed in 43us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746123.707507:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788746123.707627:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd477b6f480 x1875636163449728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746123.707652:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163449728:0@lo:400: 00010000:00010000:3.0:1788746123.771498:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746124.795204:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788746125.400286:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746125.400290:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788746125.400468:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cd448dea800 00000020:01000004:3.0:1788746125.400817:0:6677:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788746125.400829:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788746125.400844:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cd477f299c0) 00000020:00000080:3.0:1788746125.400860:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788746125.431670:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788746125.432091:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788746125.469130:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788746125.482904:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788746125.482944:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788746125.483026:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788746125.483056:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788746125.483383:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788746125.483394:0:6677:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746125.483451:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe59b64da5b309724 00000020:01000004:2.0:1788746125.483460:0:6677:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788746125.484025:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746125.484030:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746125.484036:0:6677:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788746125.484041:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788746125.484052:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cd447514d40) 00000020:00000080:2.0:1788746125.484065:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788746125.486802:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746125.487773:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746125.487783:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788746125.490043:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788746125.490055:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788746125.490526:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788746125.490534:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788746125.492223:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746125.493282:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788746125.493297:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788746125.497544:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788746125.497560:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788746125.544820:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746125.545212:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788746125.545220:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788746125.553984:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788746125.554009:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788746125.554930:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788746125.554940:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788746125.559124:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746125.559329:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788746125.559337:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788746125.560491:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788746125.560509:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788746125.677124:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746125.677311:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788746125.677319:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788746125.689380:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788746125.689545:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788746125.697213:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788746125.697241:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788746125.697247:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788746125.755217:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788746125.755250:0:6677:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.124@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788746125.755255:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788746125.755256:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746125.755258:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746125.755259:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746125.755261:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746125.755262:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746125.755263:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746125.755265:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746125.755267:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746125.755269:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746125.755270:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746125.755273:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788746125.755275:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746125.755276:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746125.755277:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746125.755279:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746125.755280:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746125.755281:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746125.755282:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746125.755283:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746125.755284:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746125.755285:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746125.755286:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746125.755311:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788746125.755328:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163449856:0@lo:253: 00000100:00100000:1.0:1788746125.755429:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746125.755483:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788746125.758064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449856 00000100:00100000:0.0:1788746125.758077:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449856 00000100:00100000:0.0:1788746125.758135:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788746125.758144:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163449856:12345-0@lo:253: 20000000:01000000:0.0:1788746125.758176:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788746125.758180:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788746125.758186:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788746125.758189:0:5844:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788746125.759177:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746125.759360:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788746125.759372:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788746125.759455:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788746125.759463:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788746125.759494:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788746125.759542:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788746125.759914:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788746125.759934:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.124@tcp 20000000:01000000:0.0:1788746125.759936:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.124@tcp (null) (null) (null) 00000040:00080000:0.0:1788746125.759972:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788746125.759980:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788746125.760024:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788746125.760040:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.124@tcp (null) (null) 00000040:00080000:0.0:1788746125.760077:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788746125.760086:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788746125.760116:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788746125.760166:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788746125.764214:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788746125.764249:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.124@tcp 20000000:01000000:2.0:1788746125.764252:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.124@tcp (null) (null) (null) 00000040:00080000:2.0:1788746125.764305:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788746125.764314:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788746125.764368:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788746125.764375:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.124@tcp (null) (null) 00000040:00080000:2.0:1788746125.764463:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788746125.764474:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788746125.764509:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788746125.764545:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788746125.764568:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788746125.764570:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788746125.764574:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788746125.764584:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788746125.764587:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788746125.764624:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788746125.764626:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788746125.765977:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788746125.766367:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788746125.766452:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788746125.766523:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788746125.766537:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788746125.766539:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788746125.767284:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788746125.767338:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788746125.767392:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788746125.767684:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788746125.767751:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788746125.767787:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788746125.767800:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788746125.767802:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788746125.769357:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788746125.769456:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788746125.769516:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788746125.774193:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788746125.774258:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788746125.774328:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788746125.774343:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788746125.774345:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788746125.774354:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788746125.774372:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.774390:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309644 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775391:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309660 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775531:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775539:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775578:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775593:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.775607:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163449984:0@lo:104: 00000100:00100000:2.0:1788746125.775662:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746125.775785:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.775794:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.775813:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163450112:0@lo:104: 00000100:00100000:2.0:1788746125.775844:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746125.783114:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.783134:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.783148:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163450240:0@lo:104: 00000100:00100000:2.0:1788746125.783195:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.783262:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163449984 00000100:00100000:3.0:1788746125.783270:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163449984 00000100:00100000:3.0:1788746125.783308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450112 00000100:00100000:3.0:1788746125.783311:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450112 00000100:00100000:3.0:1788746125.783323:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746125.783331:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:5844:x1875636163449984:12345-0@lo:104: 00010000:00010000:3.0:1788746125.783343:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783414:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746125.783420:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:5844:x1875636163449984:12345-0@lo:104: Request processed in 91us (7758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.783427:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746125.783468:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746125.783475:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5844:x1875636163450112:12345-0@lo:104: 00010000:00010000:3.0:1788746125.783483:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783521:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788746125.783526:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5844:x1875636163450112:12345-0@lo:104: Request processed in 52us (7691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.783532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788746125.783550:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746125.783555:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783563:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746125.783567:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783575:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746125.783581:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746125.783587:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746125.783614:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783620:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746125.783637:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783655:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b3096d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3096d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783667:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746125.783671:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783677:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031a00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746125.783680:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783687:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746125.783706:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746125.783711:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746125.783734:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783740:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746125.783746:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783762:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746125.783768:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746125.783770:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746125.783789:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163450368:0@lo:103: 00000100:00100000:3.0:1788746125.783816:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.783848:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746125.783853:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163450496:0@lo:103: 00000100:00100000:3.0:1788746125.783871:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.783894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450368 00000100:00100000:3.0:1788746125.783897:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450368 00010000:00010000:3.0:1788746125.783912:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 13 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746125.783930:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450496 00000100:00100000:3.0:1788746125.783944:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450496 00010000:00010000:3.0:1788746125.783953:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 14 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746125.783966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746125.783972:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:3314:x1875636163450368:12345-0@lo:103: 00010000:00010000:3.0:1788746125.783981:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746125.783986:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 14 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.783997:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 14 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.784011:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746125.784035:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:3314:x1875636163450368:12345-0@lo:103: Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.784041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746125.784058:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746125.784064:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3314:x1875636163450496:12345-0@lo:103: 00010000:00010000:3.0:1788746125.784071:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746125.784075:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 13 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.784084:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 13 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.784093:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746125.784113:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3314:x1875636163450496:12345-0@lo:103: Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.784119:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746125.784150:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163450496:0@lo:103: 00000100:00100000:3.0:1788746125.784157:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163450368:0@lo:103: 00010000:00010000:0.0:1788746125.784918:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746125.789057:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446e23480 going to sleep for 11 seconds 00010000:00010000:2.0:1788746125.789092:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b3096d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3096d0 expref: 12 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.789111:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163449984:0@lo:104: 00010000:00010000:2.0:1788746125.789122:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309660 expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.789136:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163450112:0@lo:104: 00000100:00100000:3.0:1788746125.789203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450240 00000100:00100000:3.0:1788746125.789210:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450240 00000100:00100000:3.0:1788746125.789251:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746125.789259:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5844:x1875636163450240:12345-0@lo:104: 00010000:00010000:3.0:1788746125.789274:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789356:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746125.789362:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5844:x1875636163450240:12345-0@lo:104: Request processed in 104us (6167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.789369:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788746125.789434:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746125.789442:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.789450:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746125.789454:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.789463:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746125.789470:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746125.789476:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746125.789510:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.789533:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746125.789554:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.789561:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b309644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30964b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.789578:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746125.789579:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746125.789581:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746125.789588:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746125.789601:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163450624:0@lo:103: 00000100:00100000:0.0:1788746125.789637:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.789736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450624 00000100:00100000:3.0:1788746125.789741:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450624 00010000:00010000:3.0:1788746125.789763:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746125.789792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746125.789799:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3317:x1875636163450624:12345-0@lo:103: 00010000:00010000:3.0:1788746125.789809:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746125.789814:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789825:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 11 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789850:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789859:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789872:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789879:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789885:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789892:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789897:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746125.789901:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789914:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.789922:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.790150:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746125.790192:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3317:x1875636163450624:12345-0@lo:103: Request processed in 393us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.790200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746125.790256:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163450624:0@lo:103: 00010000:00010000:2.0:1788746125.790543:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30964b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309644 expref: 10 pid: 5843 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.790555:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1875636163450240:0@lo:104: 00010000:00010000:2.0:1788746125.790572:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.790580:0:5844:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.790592:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.790598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309732 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788746125.790610:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1788746125.823675:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746125.901958:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+9:6677:x1875636163449856:12345-0@lo:253: Request processed in 143807us (146551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.901983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746125.903006:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163449856:0@lo:253: 10000000:01000000:1.0:1788746125.903022:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788746125.903025:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788746125.903027:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746125.903029:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746125.903030:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788746125.903031:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746125.903032:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746125.903034:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746125.903035:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788746125.903037:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746125.903038:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788746125.903059:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd448dea800 from lustre-OST0000 10000000:01000000:1.0:1788746125.903082:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788746125.903085:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788746125.903090:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cd445093380 local copy 10000000:01000000:1.0:1788746125.903094:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788746125.903127:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.903138:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.903147:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746125.903165:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163450752:0@lo:101: 00000100:00100000:1.0:1788746125.903206:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746125.903313:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.912373:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450752 00000100:00100000:3.0:1788746125.912389:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450752 00000100:00100000:2.0:1788746125.912555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788746125.912569:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+9:6677:x1875636163450752:12345-0@lo:101: 00010000:00010000:2.0:1788746125.912586:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746125.912605:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309739 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.912633:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309739 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.912644:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309739 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.912663:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44600, rc 0) 00000100:00100000:2.0:1788746125.912756:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+10:6677:x1875636163450752:12345-0@lo:101: Request processed in 191us (9548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.912762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746125.913898:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163450752:0@lo:101: 00010000:00010000:1.0:1788746125.913920:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.913960:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746125.914090:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163450880:0@lo:501: 00000100:00100000:1.0:1788746125.914134:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746125.914168:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.914372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163450880 00000100:00100000:3.0:1788746125.914379:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163450880 00000100:00100000:3.0:1788746125.914433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746125.914443:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+10:6677:x1875636163450880:12345-0@lo:501: 00000100:00100000:3.0:1788746125.914665:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+10:6677:x1875636163450880:12345-0@lo:501: Request processed in 214us (520us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788746125.914673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788746125.915300:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163450880:0@lo:501: 10000000:01000000:1.0:1788746125.915317:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788746125.915352:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788746125.915359:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.915370:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.915378:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.915426:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788746125.915447:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd448dea800 10000000:01000000:1.0:1788746125.915452:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788746125.915457:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cd445093380 10000000:01000000:1.0:1788746125.915459:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788746125.915463:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cd445093380 from 1 10000000:01000000:1.0:1788746125.915465:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788746125.915491:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.915511:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746125.915521:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746125.915537:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451008:0@lo:101: 00010000:00010000:0.0:1788746125.915569:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788746125.915575:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788746125.915576:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915583:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478a00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746125.915587:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915594:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746125.915598:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d6c0 going to sleep for 11 seconds 10000000:00010000:0.0:1788746125.915600:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746125.915616:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746125.915633:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915639:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788746125.915667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451008 00000100:00100000:2.0:1788746125.915672:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451008 00010000:00010000:0.0:1788746125.915672:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915678:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441478a00/0xe59b64da5b309739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309740 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915693:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746125.915695:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746125.915697:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746125.915725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746125.915734:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+10:6677:x1875636163451008:12345-0@lo:101: 00010000:00010000:2.0:1788746125.915743:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746125.915762:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b30974e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309747 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.915783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b30974e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309747 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.915794:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b30974e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309747 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.915802:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45e00, rc 0) 00000100:00100000:2.0:1788746125.915843:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451008:12345-0@lo:101: Request processed in 111us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.915850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788746125.915957:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451008:0@lo:101: 00010000:00010000:0.0:1788746125.915969:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.915977:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746125.915990:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788746125.916006:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.916014:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746125.916020:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788746125.916030:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746125.916035:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788746125.916037:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788746125.916052:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.916059:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.916067:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746125.916078:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451264:0@lo:101: 00000100:00100000:0.0:1788746125.916121:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.916143:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746125.916143:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.916153:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163451136:0@lo:103: 00000100:00100000:3.0:1788746125.916182:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746125.916257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451264 00000100:00100000:2.0:1788746125.916262:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451264 00000100:00100000:2.0:1788746125.916290:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788746125.916296:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451264:12345-0@lo:101: 00010000:00010000:2.0:1788746125.916303:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746125.916313:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309755 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.916325:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309755 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.916333:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309755 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.916339:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45400, rc 0) 00000100:00100000:2.0:1788746125.916365:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163451264:12345-0@lo:101: Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.916379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746125.916504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451136 00000100:00100000:0.0:1788746125.916509:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451136 00000100:00100000:0.0:1788746125.916538:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746125.916545:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3316:x1875636163451136:12345-0@lo:103: 00010000:00010000:0.0:1788746125.916554:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746125.916565:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44600/0xe59b64da5b309740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309739 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.916575:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746125.916609:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:3316:x1875636163451136:12345-0@lo:103: Request processed in 64us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746125.916615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746125.916645:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163451136:0@lo:103: 00000100:00100000:0.0:1788746125.916645:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451264:0@lo:101: 00010000:00010000:0.0:1788746125.916656:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.916669:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746125.916755:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451392:0@lo:501: 00000100:00100000:0.0:1788746125.916780:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746125.916808:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746125.916818:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451392 00000100:00100000:2.0:1788746125.916822:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451392 00000100:00100000:2.0:1788746125.916853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788746125.916859:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451392:12345-0@lo:501: 00000100:00100000:2.0:1788746125.917195:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451392:12345-0@lo:501: Request processed in 335us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.917202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746125.925130:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451392:0@lo:501: 00000100:00100000:0.0:1788746125.925190:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451520:0@lo:503: 00000100:00100000:0.0:1788746125.925271:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746125.925387:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746125.932126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451520 00000100:00100000:2.0:1788746125.932140:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451520 00000100:00100000:2.0:1788746125.932212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788746125.932222:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451520:12345-0@lo:503: 00000100:00100000:2.0:1788746125.932488:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451520:12345-0@lo:503: Request processed in 266us (7214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.932496:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788746125.932708:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451520:0@lo:503: 00000040:00080000:1.0:1788746125.932993:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788746125.933058:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451648:0@lo:502: 00000100:00100000:1.0:1788746125.933104:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746125.933145:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.933336:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451648 00000100:00100000:3.0:1788746125.933342:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451648 00000100:00100000:3.0:1788746125.933376:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788746125.933391:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451648:12345-0@lo:502: 00000100:00100000:3.0:1788746125.933591:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451648:12345-0@lo:502: Request processed in 200us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.933598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746125.933842:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451648:0@lo:502: 00000040:00080000:1.0:1788746125.934177:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788746125.934237:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788746125.934274:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788746125.934324:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788746125.934363:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788746125.937595:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788746125.937667:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451776:0@lo:502: 00000100:00100000:1.0:1788746125.937764:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746125.937799:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746125.938079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451776 00000100:00100000:0.0:1788746125.938087:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451776 00000100:00100000:0.0:1788746125.938190:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788746125.938200:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451776:12345-0@lo:502: 00000100:00100000:0.0:1788746125.938461:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451776:12345-0@lo:502: Request processed in 262us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746125.938469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788746125.938552:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451776:0@lo:502: 00000040:00080000:1.0:1788746125.938704:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788746125.938734:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788746125.939626:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788746125.939634:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788746125.939640:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746125.939643:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788746125.939647:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788746125.939661:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cd447510000) 00000020:00000080:2.0:1788746125.939681:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788746125.939701:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788746125.939779:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd448dea800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788746125.939787:0:6696:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788746125.939794:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe59b64da5b30976a 00010000:00010000:2.0:1788746125.944013:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788746125.944328:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788746125.956024:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788746125.956296:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788746125.968356:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788746125.969503:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788746125.970781:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788746125.970793:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746125.970800:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746125.970802:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788746125.970805:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746125.970808:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746125.970810:0:6696:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788746125.970813:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788746125.970815:0:6696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788746125.970858:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746125.970862:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746125.970863:0:6696:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788746125.970867:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788746125.971085:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788746125.971107:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788746125.971125:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971137:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746125.971144:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448dea800 from 1 10000000:01000000:3.0:1788746125.971147:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746125.971177:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971186:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971196:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746125.971217:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451904:0@lo:101: 00000100:00100000:3.0:1788746125.971279:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.971320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163451904 00000100:00100000:3.0:1788746125.971326:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163451904 00000100:00100000:3.0:1788746125.971364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746125.971372:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:6677:x1875636163451904:12345-0@lo:101: 00010000:00010000:3.0:1788746125.971393:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746125.971439:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309771 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971461:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309771 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971471:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309771 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971480:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b800, rc 0) 00000100:00100000:3.0:1788746125.971509:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163451904:12345-0@lo:101: Request processed in 137us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.971515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746125.971574:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.971594:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163451904:0@lo:101: 00010000:00010000:3.0:1788746125.971606:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746125.971615:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746125.971727:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452032:0@lo:501: 00000100:00100000:3.0:1788746125.971753:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.971766:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746125.973663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452032 00000100:00100000:2.0:1788746125.973675:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452032 00000100:00100000:2.0:1788746125.973741:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788746125.973752:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452032:12345-0@lo:501: 00000100:00100000:2.0:1788746125.974013:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452032:12345-0@lo:501: Request processed in 262us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746125.974020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746125.974557:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452032:0@lo:501: 00000100:00100000:3.0:1788746125.974602:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452160:0@lo:503: 00000100:00100000:3.0:1788746125.974657:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.974765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452160 00000100:00100000:3.0:1788746125.974771:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452160 00000100:00100000:3.0:1788746125.974806:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788746125.974814:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452160:12345-0@lo:503: 00000100:00100000:3.0:1788746125.975026:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452160:12345-0@lo:503: Request processed in 212us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.975033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788746125.975077:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.975091:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452160:0@lo:503: 00000040:00080000:3.0:1788746125.975378:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746125.975465:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452288:0@lo:502: 00000100:00100000:3.0:1788746125.975502:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.975529:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452288 00000100:00100000:3.0:1788746125.975533:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452288 00000100:00100000:3.0:1788746125.975559:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788746125.975567:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452288:12345-0@lo:502: 00000100:00100000:3.0:1788746125.976832:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452288:12345-0@lo:502: Request processed in 1260us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.976844:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788746125.976910:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd450211300 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.976934:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452288:0@lo:502: 00000040:00080000:3.0:1788746125.977216:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788746125.977276:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788746125.977310:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452416:0@lo:502: 00000100:00100000:3.0:1788746125.977364:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.977489:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd450211300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746125.983904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452416 00000100:00100000:2.0:1788746125.983916:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452416 00000100:00100000:3.0:1788746125.984093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788746125.984105:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452416:12345-0@lo:502: 00000100:00100000:3.0:1788746125.984379:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452416:12345-0@lo:502: Request processed in 276us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.984387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746125.984519:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452416:0@lo:502: 00000040:00080000:1.0:1788746125.985286:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788746125.985307:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788746125.985906:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746125.985915:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746125.985918:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788746125.985925:0:6700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448dea800 00000020:00000080:1.0:1788746125.985927:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746125.985950:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746125.985953:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746125.985955:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788746125.985957:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788746125.986073:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788746125.986095:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788746125.986118:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.986145:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746125.986184:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788746125.986188:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd448dea800 10000000:01000000:2.0:1788746125.986191:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd448dea800 10000000:01000000:2.0:1788746125.986195:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788746125.986201:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448dea800 from 1 10000000:01000000:2.0:1788746125.986204:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788746125.986237:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.986246:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.986257:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.986277:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452544:0@lo:101: 00000100:00100000:2.0:1788746125.986336:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746125.986604:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746125.986657:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452544 00000100:00100000:0.0:1788746125.986664:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452544 00000100:00100000:0.0:1788746125.986785:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788746125.986796:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:6677:x1875636163452544:12345-0@lo:101: 00010000:00010000:0.0:1788746125.986809:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746125.986823:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30977f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.986847:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30977f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.986867:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30977f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746125.986876:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440030000, rc 0) 00000100:00100000:0.0:1788746125.987002:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452544:12345-0@lo:101: Request processed in 208us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746125.987009:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746125.987088:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452544:0@lo:101: 00010000:00010000:2.0:1788746125.987102:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746125.987110:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746125.987201:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452672:0@lo:501: 00000100:00100000:2.0:1788746125.987227:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746125.987287:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.987318:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452672 00000100:00100000:3.0:1788746125.987323:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452672 00000100:00100000:3.0:1788746125.987385:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788746125.987394:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452672:12345-0@lo:501: 00000100:00100000:3.0:1788746125.987810:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452672:12345-0@lo:501: Request processed in 417us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.987818:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746125.987959:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452672:0@lo:501: 00000100:00100000:2.0:1788746125.987992:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452800:0@lo:503: 00000100:00100000:2.0:1788746125.988034:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746125.988093:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746125.988123:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452800 00000100:00100000:3.0:1788746125.988128:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452800 00000100:00100000:3.0:1788746125.988159:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788746125.988167:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452800:12345-0@lo:503: 00000100:00100000:3.0:1788746125.988360:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452800:12345-0@lo:503: Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746125.988367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788746125.988685:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452800:0@lo:503: 00000040:00080000:3.0:1788746125.989248:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746125.989314:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452928:0@lo:502: 00000100:00100000:3.0:1788746125.989363:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.989667:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eaa8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788746125.989918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163452928 00000100:00100000:0.0:1788746125.989925:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163452928 00000100:00100000:1.0:1788746125.990055:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788746125.990065:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452928:12345-0@lo:502: 00000100:00100000:1.0:1788746125.990272:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163452928:12345-0@lo:502: Request processed in 208us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746125.990279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788746125.990353:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163452928:0@lo:502: 00000040:00080000:3.0:1788746125.990665:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788746125.990740:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788746125.990782:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788746125.990826:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788746125.990860:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788746125.990909:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788746125.990944:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788746125.990973:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788746125.991019:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788746125.991051:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788746125.991080:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788746125.991118:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788746125.991147:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788746125.991176:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788746125.991217:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788746125.991248:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788746125.991299:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788746125.991360:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788746125.991428:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788746125.991465:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788746125.991526:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788746125.991560:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788746125.991590:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788746125.991633:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788746125.991665:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788746125.991694:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788746125.991752:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788746125.991787:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788746125.991825:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163453056:0@lo:502: 00000100:00100000:3.0:1788746125.991888:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746125.992581:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44ff61f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746125.992657:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453056 00000100:00100000:0.0:1788746125.992664:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453056 00000100:00100000:0.0:1788746125.992777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788746125.992786:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163453056:12345-0@lo:502: 00000100:00100000:0.0:1788746125.993052:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163453056:12345-0@lo:502: Request processed in 267us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746125.993061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788746125.993185:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163453056:0@lo:502: 00000040:00080000:3.0:1788746125.993274:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788746125.993293:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788746125.994077:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788746125.994101:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cd3452cb380) 00000020:00000080:1.0:1788746125.994121:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788746125.994197:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd448dea800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788746125.994201:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd448dea800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788746125.994204:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448dea800 3 00010000:00080000:1.0:1788746125.994231:0:6701:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd477f22800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.124@tcp at head 00010000:00010000:1.0:1788746125.999081:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788746125.999349:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788746125.999386:0:6701:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788746125.999427:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe59b64da5b309794 00000100:00080000:1.0:1788746125.999437:0:6701:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746125.999455:0:6701:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cd477f22800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746125.999487:0:6701:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd476fdea00 x1875636163453184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746125.999506:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788746125.999739:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163453184:0@lo:38: 00000100:00100000:2.0:1788746125.999802:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746126.000019:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746126.000029:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163453312:0@lo:400: 00000100:00100000:3.0:1788746126.000059:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746126.000097:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453184 00000100:00100000:3.0:1788746126.000104:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453184 00000100:00100000:3.0:1788746126.000134:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453312 00000100:00100000:3.0:1788746126.000137:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453312 00000100:00100000:3.0:1788746126.000164:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746126.000172:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163453312:12345-0@lo:400: 00000100:00100000:3.0:1788746126.000223:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163453312:12345-0@lo:400: Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746126.000231:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746126.000247:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746126.000251:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163453184:12345-0@lo:38: 00010000:00080000:3.0:1788746126.000271:0:5849:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788746126.000300:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe59b64da5b30979b 00000004:00100000:3.0:1788746126.000314:0:5849:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788746126.000344:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746126.000382:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875636163453184:12345-0@lo:38: Request processed in 129us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746126.000388:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788746126.000456:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd4446d1180 x1875636163453312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746126.000469:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163453312:0@lo:400: 00010000:00080000:3.0:1788746126.000501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd476fdea00 x1875636163453184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746126.000523:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746126.000529:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788746126.000537:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788746126.000541:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788746126.000543:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd477f22800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788746126.000549:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163453184:0@lo:38: 00000040:00080000:2.0:1788746126.001661:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788746126.006822:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788746126.006863:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788746126.006886:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.006899:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788746126.006966:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788746126.006968:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746126.006969:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746126.006971:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746126.006972:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746126.006973:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746126.006975:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746126.006976:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746126.006978:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746126.006979:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746126.006981:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746126.006984:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788746126.006986:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746126.006988:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746126.006989:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746126.006990:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746126.006991:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746126.006992:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746126.006993:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746126.006995:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788746126.006995:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788746126.006996:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746126.006998:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746126.007029:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788746126.007045:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163453440:0@lo:253: 00000100:00100000:1.0:1788746126.007108:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746126.007149:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453440 00000100:00100000:1.0:1788746126.007156:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453440 00000100:00100000:1.0:1788746126.007195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788746126.007203:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163453440:12345-0@lo:253: 20000000:01000000:1.0:1788746126.007226:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788746126.007239:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788746126.008799:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d240 going to sleep for 11 seconds 20000000:01000000:1.0:1788746126.045098:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788746126.045150:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788746126.055920:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6677:x1875636163453440:12345-0@lo:253: Request processed in 48707us (48800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746126.055936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788746126.056082:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:6677:1875636163453440:0@lo:253: 10000000:01000000:0.0:1788746126.056100:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788746126.056104:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746126.056106:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788746126.056107:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746126.056109:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746126.056111:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746126.056122:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746126.056124:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746126.056126:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746126.056127:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746126.056129:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746126.056130:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788746126.056162:0:6677:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788746126.057792:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788746126.057801:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788746126.057827:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.057845:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.057854:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.057896:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.057912:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 12 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746126.057926:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163453568:0@lo:104: 00000100:00100000:3.0:1788746126.057983:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746126.058050:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44ff61f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746126.058141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453568 00000100:00100000:1.0:1788746126.058150:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453568 00000100:00100000:1.0:1788746126.058196:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746126.058206:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163453568:12345-0@lo:104: 00010000:00010000:1.0:1788746126.058219:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058281:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746126.058288:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163453568:12345-0@lo:104: Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746126.058296:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788746126.058318:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746126.058323:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058332:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746126.058336:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058365:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746126.058373:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746126.058379:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788746126.058430:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058438:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746126.058452:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058460:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b3096fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.058477:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746126.058479:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746126.058481:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746126.058548:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746126.058561:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163453696:0@lo:103: 00000100:00100000:2.0:1788746126.058596:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746126.058705:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163453568:0@lo:104: 00010000:00010000:3.0:1788746126.058733:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746126.062178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453696 00000100:00100000:1.0:1788746126.062193:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453696 00010000:00010000:1.0:1788746126.062232:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 13 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746126.062271:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746126.062280:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3314:x1875636163453696:12345-0@lo:103: 00010000:00010000:1.0:1788746126.062295:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746126.062300:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 13 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062330:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 13 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062347:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479200/0xe59b64da5b309701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3096fa expref: 13 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062366:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062374:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788746126.062390:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004589680s 00010000:00010000:1.0:1788746126.062395:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062421:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062428:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062435:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062441:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09b400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746126.062445:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062452:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062471:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746126.062482:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746126.062545:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3314:x1875636163453696:12345-0@lo:103: Request processed in 267us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746126.062552:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788746126.062860:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163453696:0@lo:103: 00010000:00010000:3.0:1788746126.064889:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.064907:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746126.064915:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3097a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788746126.072245:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746126.072473:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746126.072692:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746126.072914:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746126.073096:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746126.073318:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788746126.075621:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788746126.345626:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788746126.345633:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788746126.345662:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788746126.345744:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788746126.345757:0:6677:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788746126.345786:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788746126.842653:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746127.866990:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746128.895865:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746129.914631:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746130.939269:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788746131.387389:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788746131.387410:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448caf000 from 21 10000000:01000000:1.0:1788746131.387415:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788746131.387458:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.387469:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.387479:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746131.387516:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163453824:0@lo:101: 00000100:00100000:1.0:1788746131.387579:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.387620:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.387848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453824 00000100:00100000:2.0:1788746131.387856:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453824 00000100:00100000:2.0:1788746131.387909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788746131.387918:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163453824:12345-0@lo:101: 00010000:00010000:2.0:1788746131.387930:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746131.387942:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3097a9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.387972:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.387982:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.387991:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44200, rc 0) 00000100:00100000:2.0:1788746131.388032:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163453824:12345-0@lo:101: Request processed in 115us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.388038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788746131.388105:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163453824:0@lo:101: 00010000:00010000:2.0:1788746131.388118:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.388127:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746131.388184:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163453952:0@lo:501: 00000100:00100000:2.0:1788746131.388225:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.388240:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.388590:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163453952 00000100:00100000:2.0:1788746131.388595:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163453952 00000100:00100000:2.0:1788746131.388621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788746131.388629:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163453952:12345-0@lo:501: 00000100:00100000:2.0:1788746131.388925:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163453952:12345-0@lo:501: Request processed in 297us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.388933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788746131.390833:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163454208:0@lo:400: 00000100:00100000:0.0:1788746131.390893:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.391846:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163453952:0@lo:501: 00000100:00100000:2.0:1788746131.391893:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454336:0@lo:503: 00000100:00100000:2.0:1788746131.391953:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.391988:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.392008:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163454080:0@lo:400: 00000100:00100000:2.0:1788746131.392102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454336 00000100:00100000:2.0:1788746131.392109:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454336 00000100:00100000:2.0:1788746131.392151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788746131.392160:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163454336:12345-0@lo:503: 00000100:00100000:2.0:1788746131.395104:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163454336:12345-0@lo:503: Request processed in 2938us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.395115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788746131.395874:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454336:0@lo:503: 00000100:00100000:2.0:1788746131.395919:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.396076:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454208 00000100:00100000:1.0:1788746131.396084:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454208 00000100:00100000:1.0:1788746131.396132:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454080 00000100:00100000:1.0:1788746131.396134:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454080 00000100:00100000:1.0:1788746131.396147:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746131.396153:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163454208:12345-0@lo:400: 00000100:00100000:1.0:1788746131.396214:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163454208:12345-0@lo:400: Request processed in 50us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.396220:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746131.396235:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746131.396240:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163454080:12345-0@lo:400: 00000100:00100000:1.0:1788746131.396268:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163454080:12345-0@lo:400: Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.396274:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788746131.396518:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd446269c00 x1875636163454208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746131.396530:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163454208:0@lo:400: 00010000:00080000:2.0:1788746131.396945:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd44626a300 x1875636163454080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746131.396955:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163454080:0@lo:400: 00000100:00080000:3.0:1788746131.397296:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746131.401420:0:6948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6948:1875636163454464:0@lo:502: 00000100:00100000:1.0:1788746131.401501:0:6948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.401537:0:6948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.402823:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454464 00000100:00100000:2.0:1788746131.402834:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454464 00000100:00100000:2.0:1788746131.402882:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788746131.402891:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6948:x1875636163454464:12345-0@lo:502: 00000100:00100000:2.0:1788746131.403189:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6948:x1875636163454464:12345-0@lo:502: Request processed in 298us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.403196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788746131.403392:0:6948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6948:1875636163454464:0@lo:502: 00000100:00100000:1.0:1788746131.403480:0:6948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6948:1875636163454592:0@lo:502: 00000100:00100000:1.0:1788746131.403524:0:6948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.403553:0:6948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.403780:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454592 00000100:00100000:2.0:1788746131.403791:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454592 00000100:00100000:2.0:1788746131.403819:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788746131.403826:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6948:x1875636163454592:12345-0@lo:502: 00000100:00100000:2.0:1788746131.403966:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:6948:x1875636163454592:12345-0@lo:502: Request processed in 140us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.403973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788746131.404050:0:6948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6948:1875636163454592:0@lo:502: 00000040:00080000:1.0:1788746131.404068:0:6948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788746131.405330:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788746131.405513:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788746131.405523:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405535:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746131.405544:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788746131.405547:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448caf000 from 4 10000000:01000000:2.0:1788746131.405550:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788746131.405581:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405589:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405599:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746131.405614:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454720:0@lo:101: 00000100:00100000:2.0:1788746131.405779:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.405812:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd3452616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.405839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454720 00000100:00100000:2.0:1788746131.405851:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454720 00000100:00100000:2.0:1788746131.405918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788746131.405926:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163454720:12345-0@lo:101: 00010000:00010000:2.0:1788746131.405937:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746131.405947:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3097b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405968:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405977:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.405984:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44000, rc 0) 00000100:00100000:2.0:1788746131.406013:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163454720:12345-0@lo:101: Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.406018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788746131.418953:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454720:0@lo:101: 00010000:00010000:1.0:1788746131.418982:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.418995:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746131.419066:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454848:0@lo:256: 00000100:00100000:1.0:1788746131.419128:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.419170:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.427057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454848 00000100:00100000:2.0:1788746131.427070:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454848 00000100:00100000:2.0:1788746131.427127:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746131.427137:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163454848:12345-0@lo:256: 20000000:01000000:2.0:1788746131.427160:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788746131.427177:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788746131.427180:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788746131.427306:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163454848:12345-0@lo:256: Request processed in 170us (8177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.427314:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746131.427381:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454848:0@lo:256: 10000000:01000000:2.0:1788746131.427456:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788746131.427470:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427481:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746131.427490:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788746131.427493:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788746131.427496:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788746131.427524:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427532:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427541:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746131.427559:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454976:0@lo:101: 00000100:00100000:2.0:1788746131.427590:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.427617:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.427639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163454976 00000100:00100000:2.0:1788746131.427643:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163454976 00000100:00100000:2.0:1788746131.427666:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746131.427673:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163454976:12345-0@lo:101: 00010000:00010000:2.0:1788746131.427681:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746131.427704:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3097c5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427724:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427741:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427750:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:2.0:1788746131.427778:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163454976:12345-0@lo:101: Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.427784:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746131.427813:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163454976:0@lo:101: 00010000:00010000:2.0:1788746131.427824:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746131.427832:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746131.427877:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455104:0@lo:501: 00000100:00100000:2.0:1788746131.427900:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.427912:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.427922:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455104 00000100:00100000:2.0:1788746131.427925:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455104 00000100:00100000:2.0:1788746131.427944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788746131.427950:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163455104:12345-0@lo:501: 00000100:00100000:2.0:1788746131.428179:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163455104:12345-0@lo:501: Request processed in 227us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.428186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788746131.428217:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455104:0@lo:501: 00000100:00100000:2.0:1788746131.428243:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455232:0@lo:503: 00000100:00100000:2.0:1788746131.428283:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.428296:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.428307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455232 00000100:00100000:2.0:1788746131.428310:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455232 00000100:00100000:2.0:1788746131.428330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746131.428336:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163455232:12345-0@lo:503: 00000100:00100000:2.0:1788746131.428617:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163455232:12345-0@lo:503: Request processed in 280us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.428624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746131.428664:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455232:0@lo:503: 00000100:00100000:3.0:1788746131.431616:0:6949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6949:1875636163455360:0@lo:502: 00000100:00100000:3.0:1788746131.431710:0:6949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746131.431757:0:6949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd34725ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.433567:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455360 00000100:00100000:2.0:1788746131.433580:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455360 00000100:00100000:2.0:1788746131.433628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746131.433638:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:6949:x1875636163455360:12345-0@lo:502: 00000100:00100000:2.0:1788746131.434027:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:6949:x1875636163455360:12345-0@lo:502: Request processed in 390us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746131.434036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788746131.436604:0:6949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6949:1875636163455360:0@lo:502: 00000020:01000000:1.0:1788746131.445028:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788746131.445042:0:6949:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788746131.445070:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746131.445073:0:6949:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788746131.445080:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788746131.445086:0:6949:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.124@tcp to nid 0x20000c0a8ce7c (192.168.206.124@tcp) 00000020:01000000:1.0:1788746131.445113:0:6949:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788746131.445116:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746131.445133:0:6949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cd3452ccd40) 00000020:00000080:1.0:1788746131.445157:0:6949:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788746131.445162:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788746131.445241:0:6949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788746131.445247:0:6949:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788746131.445260:0:6949:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b3097da 00010000:00080000:1.0:1788746131.445292:0:6949:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd45fa5a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:1.0:1788746131.445532:0:6949:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788746131.529935:0:6949:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788746131.529959:0:6949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788746131.530961:0:6949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746131.531372:0:6949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746131.531445:0:6949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788746131.531496:0:6949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788746131.532458:0:6960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746131.532465:0:6960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788746131.533956:0:6949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788746131.533968:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788746131.534000:0:6949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788746131.534021:0:6949:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b3097e1 00000100:00080000:1.0:1788746131.534047:0:6949:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746131.534057:0:6949:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cd45fa5a800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746131.534089:0:6949:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd476fdfb80 x1875636163455488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746131.534117:0:6949:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788746131.534166:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746131.534170:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746131.534172:0:6949:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788746131.534175:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746131.534178:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746131.534180:0:6949:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788746131.534183:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788746131.534185:0:6949:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788746131.534220:0:6949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6949:1875636163455616:0@lo:502: 00000100:00100000:1.0:1788746131.534293:0:6949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.534334:0:6949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746131.534366:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455616 00000100:00100000:1.0:1788746131.534379:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455616 00000100:00100000:1.0:1788746131.534438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788746131.534447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:6949:x1875636163455616:12345-0@lo:502: 00000100:00100000:1.0:1788746131.534662:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:6949:x1875636163455616:12345-0@lo:502: Request processed in 216us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.534670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788746131.534735:0:6949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:6949:1875636163455616:0@lo:502: 00000020:01000000:1.0:1788746131.534758:0:6949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746131.534762:0:6949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746131.534764:0:6949:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788746131.534768:0:6949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788746131.534806:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163455488:0@lo:8: 00000100:00100000:0.0:1788746131.534840:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788746131.534864:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:0.0:1788746131.534871:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455488 00000100:00100000:0.0:1788746131.534874:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455488 10000000:01000000:1.0:1788746131.534880:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788746131.534888:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746131.534893:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746131.534897:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875636163455488:12345-0@lo:8: 00010000:00010000:1.0:1788746131.534899:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746131.534907:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788746131.534909:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cd445093380 from 1 10000000:01000000:1.0:1788746131.534912:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00080000:0.0:1788746131.534915:0:6680:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00010000:00010000:1.0:1788746131.534932:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788746131.534936:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b3097e8 00010000:00010000:1.0:1788746131.534940:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.534948:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788746131.534965:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cd344956000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788746131.534967:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455744:0@lo:101: 00002000:00080000:0.0:1788746131.534969:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788746131.534973:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788746131.534991:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.535006:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746131.535019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455744 00000100:00100000:1.0:1788746131.535022:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455744 00000100:00100000:1.0:1788746131.535040:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788746131.535045:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163455744:12345-0@lo:101: 00010000:00010000:1.0:1788746131.535053:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746131.535063:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3097ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788746131.535070:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1788746131.535082:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.535091:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.535099:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478e00, rc 0) 00000100:00100000:1.0:1788746131.535126:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163455744:12345-0@lo:101: Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.535131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788746131.535158:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455744:0@lo:101: 00010000:00010000:1.0:1788746131.535169:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746131.535177:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788746131.535212:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788746131.535219:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455872:0@lo:501: 00000100:00100000:1.0:1788746131.535243:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788746131.535253:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9cd344955800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746131.535254:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746131.535266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163455872 00000100:00100000:1.0:1788746131.535269:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163455872 00000100:00100000:1.0:1788746131.535287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788746131.535288:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875636163455488:12345-0@lo:8: Request processed in 389us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.535293:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163455872:12345-0@lo:501: 00000100:00100000:0.0:1788746131.535295:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788746131.535323:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdfb80 x1875636163455488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746131.535331:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746131.535337:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788746131.535343:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788746131.535351:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788746131.535353:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd45fa5a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788746131.535361:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788746131.535365:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163455488:0@lo:8: 00000100:00100000:1.0:1788746131.535484:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163455872:12345-0@lo:501: Request processed in 190us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788746131.535491:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788746131.536637:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163455872:0@lo:501: 10000000:01000000:0.0:1788746131.536668:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788746131.536677:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746131.536695:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746131.538369:0:6960:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788746131.540234:0:6960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 205944833768ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788746131.607736:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163456000:0@lo:13: 00000100:00100000:2.0:1788746131.607816:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788746131.607962:0:6962:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788746131.607984:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456128:0@lo:7: 00000100:00100000:1.0:1788746131.608013:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.608054:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45009c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788746131.608075:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456128 00000100:00100000:1.0:1788746131.608083:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456128 00000100:00100000:1.0:1788746131.608136:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746131.608145:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875636163456128:12345-0@lo:7: 00000100:00080000:3.0:1788746131.608307:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746131.611483:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456000 00000100:00100000:0.0:1788746131.611494:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456000 00000100:00100000:0.0:1788746131.611542:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746131.611552:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163456000:12345-0@lo:13: 00002000:00000024:0.0:1788746131.611583:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788746131.611667:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163456000:12345-0@lo:13: Request processed in 116us (3850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746131.611673:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788746131.611838:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdd180 x1875636163456000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746131.611858:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163456000:0@lo:13: 00002000:00080000:1.0:1788746131.616820:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788746131.616828:0:6682:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788746131.616913:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875636163456128:12345-0@lo:7: Request processed in 8765us (8895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746131.616922:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788746131.617166:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fddf80 x1875636163456128/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788746147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746131.617180:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456128:0@lo:7: 00000004:00080000:0.0:1788746131.617194:0:6962:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788746131.617231:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456256:0@lo:5: 00000100:00100000:0.0:1788746131.617264:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746131.617308:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788746131.617326:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456256 00000100:00100000:0.0:1788746131.617333:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456256 00000100:00100000:0.0:1788746131.617368:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746131.617376:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6962:x1875636163456256:12345-0@lo:5: 00002000:00080000:0.0:1788746131.617417:0:6681:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788746131.617422:0:6681:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788746131.617742:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6962:x1875636163456256:12345-0@lo:5: Request processed in 366us (476us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788746131.617749:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788746131.618337:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd446268700 x1875636163456256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746131.618352:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456256:0@lo:5: 00000004:00080000:1.0:1788746131.618369:0:6962:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788746131.618422:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456384:0@lo:700: 00000100:00100000:1.0:1788746131.618455:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746131.618478:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45009ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746131.618490:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456384 00000100:00100000:3.0:1788746131.618495:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456384 00000100:00100000:3.0:1788746131.618523:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746131.618531:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6962:x1875636163456384:12345-0@lo:700: 00000100:00100000:3.0:1788746131.618559:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875636163456512:0@lo:700: 00000100:00100000:3.0:1788746131.618591:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746131.618615:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd34725ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746131.618884:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456512 00000100:00100000:2.0:1788746131.618889:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456512 00000100:00100000:2.0:1788746131.618915:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746131.618922:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875636163456512:12345-0@lo:700: 00000004:00080000:2.0:1788746131.638828:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788746131.694330:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788746131.708331:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875636163456512:12345-0@lo:700: Request processed in 89402us (89732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746131.708349:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788746131.708354:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd4446d3480 x1875636163456512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788746147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746131.708367:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875636163456512:0@lo:700: 40000000:02000000:2.0:1788746131.708381:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788746131.800623:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788746131.800640:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788746131.800844:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6962:x1875636163456384:12345-0@lo:700: Request processed in 182308us (182383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746131.800857:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788746131.800921:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdf480 x1875636163456384/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788746147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746131.800933:0:6962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788746131.800950:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456384:0@lo:700: 00000004:02000040:3.0:1788746131.841290:0:6962:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788746131.845207:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456640:0@lo:5: 00000100:00100000:2.0:1788746131.845273:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746131.845362:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4463139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746131.845475:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456640 00000100:00100000:3.0:1788746131.845483:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456640 00000100:00100000:3.0:1788746131.845530:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746131.845538:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6962:x1875636163456640:12345-0@lo:5: 00002000:00080000:3.0:1788746131.850158:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788746131.850176:0:6682:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788746131.853195:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875636163456640:12345-0@lo:5: Request processed in 7652us (7915us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788746131.853208:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788746131.853281:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd477b6ea00 x1875636163456640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746131.853300:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875636163456640:0@lo:5: 00000004:00080000:2.0:1788746131.853317:0:6962:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788746131.971896:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746132.989040:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746133.046177:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788746134.015138:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746135.035785:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746136.058537:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746137.018843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163456768:0@lo:13: 00000100:00100000:2.0:1788746137.019000:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163456896:0@lo:400: 00000100:00100000:2.0:1788746137.019056:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746137.019101:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746137.019108:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163457024:0@lo:400: 00000100:00100000:2.0:1788746137.019134:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746137.019199:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746137.019230:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163457280:0@lo:400: 00000100:00100000:1.0:1788746137.019252:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746137.019270:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746137.019275:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163457152:0@lo:400: 00000100:00100000:1.0:1788746137.019296:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746137.019330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456896 00000100:00100000:1.0:1788746137.019336:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456896 00000100:00100000:1.0:1788746137.019374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788746137.019383:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3316:x1875636163456896:12345-0@lo:400: 00000100:00100000:1.0:1788746137.019451:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3316:x1875636163456896:12345-0@lo:400: Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746137.019458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788746137.019485:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457024 00000100:00100000:1.0:1788746137.019488:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457024 00000100:00100000:1.0:1788746137.019508:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457152 00000100:00100000:1.0:1788746137.019510:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457152 00000100:00100000:1.0:1788746137.019530:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746137.019535:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163457024:12345-0@lo:400: 00000100:00100000:1.0:1788746137.019561:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163457024:12345-0@lo:400: Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746137.019575:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746137.019586:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746137.019591:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163457152:12345-0@lo:400: 00000100:00100000:1.0:1788746137.019616:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163457152:12345-0@lo:400: Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746137.019621:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746137.019635:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457280 00000100:00100000:1.0:1788746137.019638:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457280 00000100:00100000:1.0:1788746137.019669:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746137.019676:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163457280:12345-0@lo:400: 00000100:00100000:1.0:1788746137.019700:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163457280:12345-0@lo:400: Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746137.019705:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788746137.019725:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746137.019729:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788746137.019748:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd477b6f480 x1875636163457024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746137.019761:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163457024:0@lo:400: 00000100:00100000:1.0:1788746137.019768:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163456896:0@lo:400: 00010000:00080000:1.0:1788746137.019791:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd477b6d500 x1875636163457152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746137.019799:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163457152:0@lo:400: 00010000:00080000:1.0:1788746137.019806:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd477b6df80 x1875636163457280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746137.019814:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163457280:0@lo:400: 00000100:00100000:2.0:1788746137.019982:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163456768 00000100:00100000:2.0:1788746137.019986:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163456768 00000100:00100000:2.0:1788746137.020008:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746137.020014:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163456768:12345-0@lo:13: 00002000:00000024:2.0:1788746137.020037:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746137.020073:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163456768:12345-0@lo:13: Request processed in 59us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746137.020078:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788746137.020192:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdd180 x1875636163456768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746137.020205:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163456768:0@lo:13: 00010000:00010000:1.0:1788746137.083673:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788746137.122293:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788746138.110687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746139.130629:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746140.154839:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746141.182131:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746142.139230:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163457536:0@lo:400: 00000100:00100000:1.0:1788746142.139295:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746142.139359:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746142.139367:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163457408:0@lo:400: 00000100:00100000:1.0:1788746142.139420:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746142.139450:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163457664:0@lo:400: 00000100:00100000:1.0:1788746142.139473:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746142.139687:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163457920:0@lo:13: 00000100:00100000:3.0:1788746142.139718:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746142.139998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457408 00000100:00100000:0.0:1788746142.140006:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457408 00000100:00100000:0.0:1788746142.140046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746142.140054:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3317:x1875636163457408:12345-0@lo:400: 00000100:00100000:0.0:1788746142.140098:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3317:x1875636163457408:12345-0@lo:400: Request processed in 44us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746142.140105:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746142.140133:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457536 00000100:00100000:0.0:1788746142.140137:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457536 00000100:00100000:0.0:1788746142.140159:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457664 00000100:00100000:0.0:1788746142.140161:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457664 00000100:00100000:0.0:1788746142.140184:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746142.140190:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163457536:12345-0@lo:400: 00000100:00100000:0.0:1788746142.140219:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163457536:12345-0@lo:400: Request processed in 30us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746142.140224:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746142.140236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746142.140249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163457664:12345-0@lo:400: 00000100:00100000:0.0:1788746142.140277:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163457664:12345-0@lo:400: Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746142.140283:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746142.140302:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163457792:0@lo:400: 00000100:00100000:0.0:1788746142.140326:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746142.140382:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163457408:0@lo:400: 00010000:00080000:0.0:1788746142.140418:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdf100 x1875636163457536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746142.140432:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163457536:0@lo:400: 00000100:00080000:0.0:1788746142.140466:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746142.140755:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457792 00000100:00100000:3.0:1788746142.140760:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457792 00000100:00100000:3.0:1788746142.140794:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746142.140801:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163457792:12345-0@lo:400: 00000100:00100000:3.0:1788746142.140842:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163457792:12345-0@lo:400: Request processed in 42us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746142.140848:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788746142.140873:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fded80 x1875636163457792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746142.140882:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788746142.140911:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163457792:0@lo:400: 00000100:00100000:2.0:1788746142.141219:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163457920 00000100:00100000:2.0:1788746142.141224:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163457920 00000100:00100000:2.0:1788746142.141254:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788746142.141261:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163457920:12345-0@lo:13: 00002000:00000024:2.0:1788746142.141287:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746142.141327:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163457920:12345-0@lo:13: Request processed in 67us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746142.141333:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788746142.141364:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd477b6e680 x1875636163457920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746142.141377:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163457920:0@lo:13: 00010000:00080000:1.0:1788746142.141464:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdc380 x1875636163457664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746142.141474:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163457664:0@lo:400: 00000100:00080000:0.0:1788746142.142222:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788746142.209172:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746143.227761:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746144.254539:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788746145.000963:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746145.000967:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788746145.001092:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cd47ebce000 00000020:01000004:3.0:1788746145.001119:0:7620:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788746145.001135:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788746145.001155:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cd45fbbb380) 00000020:00000080:3.0:1788746145.001171:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788746145.095266:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788746145.096501:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788746145.173937:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788746145.180733:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788746145.180762:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788746145.180829:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788746145.180864:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788746145.181166:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788746145.181182:0:7620:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746145.181193:0:7620:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe59b64da5b309804 00000020:01000004:2.0:1788746145.181201:0:7620:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788746145.181221:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746145.181224:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746145.181231:0:7620:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788746145.181251:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788746145.181255:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788746145.233284:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788746145.233331:0:7620:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.124@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788746145.233335:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788746145.233337:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746145.233338:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746145.233339:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746145.233341:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746145.233342:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746145.233343:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746145.233344:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746145.233346:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746145.233347:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746145.233349:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746145.233352:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788746145.233354:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746145.233355:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746145.233357:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746145.233363:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746145.233364:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746145.233365:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746145.233366:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746145.233367:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746145.233368:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746145.233368:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746145.233369:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746145.233395:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788746145.233441:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163458048:0@lo:253: 00000100:00100000:0.0:1788746145.234158:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.234353:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44848eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.234493:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458048 00000100:00100000:1.0:1788746145.234501:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458048 00000100:00100000:1.0:1788746145.234579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788746145.234594:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:7620:x1875636163458048:12345-0@lo:253: 20000000:01000000:1.0:1788746145.234655:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788746145.234659:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788746145.234663:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788746145.234665:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788746145.242802:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746145.243012:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788746145.243027:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788746145.243072:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788746145.243081:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788746145.243106:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788746145.243145:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788746145.243771:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788746145.243791:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.124@tcp 20000000:01000000:3.0:1788746145.243794:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.124@tcp (null) (null) (null) 00000040:00080000:3.0:1788746145.243831:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788746145.243839:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788746145.243898:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788746145.243906:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.124@tcp (null) (null) 00000040:00080000:3.0:1788746145.243938:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788746145.243947:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788746145.243977:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788746145.244044:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788746145.248658:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788746145.248695:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.124@tcp 20000000:01000000:3.0:1788746145.248698:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.124@tcp (null) (null) (null) 00000040:00080000:3.0:1788746145.248746:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788746145.248754:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788746145.248785:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788746145.248794:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.124@tcp (null) (null) 00000040:00080000:3.0:1788746145.248825:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788746145.248835:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788746145.248881:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788746145.248921:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788746145.248943:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788746145.251525:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788746145.251530:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788746145.251551:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788746145.251554:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788746145.251617:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788746145.251620:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788746145.252310:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788746145.252452:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788746145.252486:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788746145.252795:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788746145.252831:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788746145.252874:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788746145.252884:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788746145.252886:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788746145.253499:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788746145.253543:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788746145.253586:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788746145.253876:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788746145.253908:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788746145.253935:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788746145.253955:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788746145.253957:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788746145.254296:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788746145.254522:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788746145.254566:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788746145.254637:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788746145.254653:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788746145.254654:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788746145.257316:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788746145.257653:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788746145.257730:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788746145.259979:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788746145.260033:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788746145.260119:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788746145.260137:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788746145.260139:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788746145.260149:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788746145.260169:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260185:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309755 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260194:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30977f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260201:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260208:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260215:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260223:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260259:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260292:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.260308:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458176:0@lo:104: 00000100:00100000:3.0:1788746145.260373:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788746145.260454:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260462:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 16 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.260470:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458304:0@lo:104: 00010000:00010000:3.0:1788746145.260494:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260501:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 16 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.260509:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458432:0@lo:104: 00010000:00010000:3.0:1788746145.260526:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260532:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 16 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.260539:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458560:0@lo:104: 00010000:00010000:3.0:1788746145.260558:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.260576:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 16 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.260584:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458688:0@lo:104: 00000100:00100000:3.0:1788746145.260629:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4511999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746145.260715:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788746145.260735:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.260758:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.260767:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.260775:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.260788:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458176 00000100:00100000:2.0:1788746145.260794:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458176 00000100:00100000:2.0:1788746145.260827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458304 00000100:00100000:2.0:1788746145.260830:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458304 00000100:00100000:2.0:1788746145.260840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458432 00000100:00100000:2.0:1788746145.260843:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458432 00000100:00100000:2.0:1788746145.260852:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458560 00000100:00100000:2.0:1788746145.260854:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458560 00000100:00100000:2.0:1788746145.260862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458688 00000100:00100000:2.0:1788746145.260864:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458688 00000100:00100000:2.0:1788746145.260876:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746145.260883:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4474b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+7:5843:x1875636163458176:12345-0@lo:104: 00010000:00010000:2.0:1788746145.260895:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.260956:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788746145.260968:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4474b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+7:5843:x1875636163458176:12345-0@lo:104: Request processed in 85us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.260976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746145.261022:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746145.261030:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5843:x1875636163458304:12345-0@lo:104: 00010000:00010000:2.0:1788746145.261038:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261073:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788746145.261078:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+6:5843:x1875636163458304:12345-0@lo:104: Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.261084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746145.261098:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746145.261105:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:5843:x1875636163458432:12345-0@lo:104: 00010000:00010000:2.0:1788746145.261113:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261138:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788746145.261143:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:5843:x1875636163458432:12345-0@lo:104: Request processed in 39us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.261149:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746145.261162:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746145.261168:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:5843:x1875636163458560:12345-0@lo:104: 00010000:00010000:2.0:1788746145.261175:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261201:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788746145.261213:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:5843:x1875636163458560:12345-0@lo:104: Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.261219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746145.261233:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746145.261239:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5843:x1875636163458688:12345-0@lo:104: 00010000:00010000:2.0:1788746145.261247:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261275:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788746145.261281:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5843:x1875636163458688:12345-0@lo:104: Request processed in 42us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.261287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788746145.261305:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788746145.261311:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261318:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746145.261322:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261331:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746145.261339:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746145.261345:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746145.261373:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261389:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746145.261431:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261438:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479000/0xe59b64da5b3097ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261454:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788746145.261458:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261464:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746145.261467:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261474:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746145.261481:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746145.261486:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746145.261500:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261506:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746145.261521:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261528:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b3097c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261542:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788746145.261546:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261551:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746145.261554:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261561:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746145.261567:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746145.261572:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746145.261586:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261591:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746145.261597:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261616:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3097a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261628:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746145.261632:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261646:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44e00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746145.261649:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261656:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746145.261661:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746145.261666:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746145.261678:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261683:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746145.261688:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261694:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b30977f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309786 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261703:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746145.261706:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261711:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031a00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746145.261714:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261729:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746145.261736:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746145.261741:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746145.261753:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261758:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746145.261763:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261769:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b309755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30975c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.261784:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746145.261785:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746145.261787:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746145.261794:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746145.261815:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163458816:0@lo:103: 00000100:00100000:2.0:1788746145.262080:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.262105:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163459328:0@lo:103: 00000100:00100000:2.0:1788746145.262125:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.262144:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746145.262150:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163459200:0@lo:103: 00000100:00100000:2.0:1788746145.262174:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.262210:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163458944:0@lo:103: 00000100:00100000:2.0:1788746145.262230:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.262240:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746145.262244:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163459072:0@lo:103: 00000100:00100000:2.0:1788746145.262270:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.262301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458816 00000100:00100000:2.0:1788746145.262307:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458816 00010000:00010000:2.0:1788746145.262331:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 17 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.262348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459328 00000100:00100000:2.0:1788746145.262351:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459328 00010000:00010000:2.0:1788746145.262361:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 18 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.262371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459200 00000100:00100000:2.0:1788746145.262374:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459200 00010000:00010000:2.0:1788746145.262382:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 19 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.262390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163458944 00000100:00100000:2.0:1788746145.262391:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163458944 00010000:00010000:2.0:1788746145.262435:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 20 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.262446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459072 00000100:00100000:2.0:1788746145.262448:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459072 00010000:00010000:2.0:1788746145.262457:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 21 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.262469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746145.262474:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+21:3317:x1875636163458816:12345-0@lo:103: 00010000:00010000:2.0:1788746145.262490:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.262496:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 21 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262506:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 21 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262520:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.262553:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+21:3317:x1875636163458816:12345-0@lo:103: Request processed in 78us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.262559:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746145.262580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746145.262586:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3317:x1875636163459328:12345-0@lo:103: 00010000:00010000:2.0:1788746145.262592:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.262596:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 20 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262603:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 20 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262625:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.262646:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3317:x1875636163459328:12345-0@lo:103: Request processed in 60us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.262651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746145.262662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746145.262668:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163459200:12345-0@lo:103: 00010000:00010000:2.0:1788746145.262674:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.262678:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 19 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262693:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 19 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262702:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.262723:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163459200:12345-0@lo:103: Request processed in 55us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.262728:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746145.262740:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746145.262744:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3314:x1875636163458944:12345-0@lo:103: 00010000:00010000:2.0:1788746145.262750:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.262754:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 18 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262761:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 18 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262768:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.262788:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3314:x1875636163458944:12345-0@lo:103: Request processed in 44us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.262793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746145.262806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746145.262811:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3314:x1875636163459072:12345-0@lo:103: 00010000:00010000:2.0:1788746145.262819:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.262822:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 17 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262830:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 17 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262847:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262855:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262868:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262875:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262880:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262886:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262892:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09b400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746145.262895:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262902:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262910:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.262920:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.262944:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3314:x1875636163459072:12345-0@lo:103: Request processed in 132us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.262958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746145.263001:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163459072:0@lo:103: 00000100:00100000:2.0:1788746145.263010:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163458944:0@lo:103: 00000100:00100000:2.0:1788746145.263034:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163459200:0@lo:103: 00000100:00100000:2.0:1788746145.263041:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163458816:0@lo:103: 00000100:00100000:2.0:1788746145.263048:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163459328:0@lo:103: 00010000:00010000:3.0:1788746145.263301:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3097f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3097ef expref: 16 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.263315:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458176:0@lo:104: 00010000:00010000:3.0:1788746145.263325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44400/0xe59b64da5b3097cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3097c5 expref: 15 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.263332:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458304:0@lo:104: 00010000:00010000:3.0:1788746145.263341:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44200/0xe59b64da5b3097b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3097a9 expref: 14 pid: 5843 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.263348:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458432:0@lo:104: 00010000:00010000:3.0:1788746145.263357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440030000/0xe59b64da5b309786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30977f expref: 13 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.263366:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458560:0@lo:104: 00010000:00010000:3.0:1788746145.263375:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45400/0xe59b64da5b30975c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309755 expref: 12 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.263394:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875636163458688:0@lo:104: 00010000:00010000:3.0:1788746145.263438:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.263458:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.263464:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.263470:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b30980b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788746145.263484:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788746145.281478:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746145.383352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+11:7620:x1875636163458048:12345-0@lo:253: Request processed in 148751us (149187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.383366:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788746145.383453:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163458048:0@lo:253: 10000000:01000000:2.0:1788746145.383467:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788746145.383470:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788746145.383472:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788746145.383473:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746145.383474:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788746145.383476:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746145.383477:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746145.383478:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746145.383480:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788746145.383481:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746145.383482:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788746145.383503:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd47ebce000 from lustre-OST0001 10000000:01000000:2.0:1788746145.383526:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788746145.383529:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788746145.383536:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cd445093380 local copy 10000000:01000000:2.0:1788746145.383539:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788746145.383571:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.383592:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.383601:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.383629:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459456:0@lo:101: 00000100:00100000:2.0:1788746145.383659:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.383692:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746145.383708:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459456 00000100:00100000:2.0:1788746145.383713:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459456 00000100:00100000:2.0:1788746145.383741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788746145.383748:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+11:7620:x1875636163459456:12345-0@lo:101: 00010000:00010000:2.0:1788746145.383759:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746145.383769:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309812 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.383788:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309812 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.383797:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309812 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.383805:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45000, rc 0) 00000100:00100000:2.0:1788746145.383829:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163459456:12345-0@lo:101: Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.383834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788746145.383866:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459456:0@lo:101: 00010000:00010000:2.0:1788746145.384516:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.384525:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.384623:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459584:0@lo:501: 00000100:00100000:2.0:1788746145.384655:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.385588:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.389130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459584 00000100:00100000:0.0:1788746145.389146:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459584 00000100:00100000:0.0:1788746145.389218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788746145.389229:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163459584:12345-0@lo:501: 00000100:00100000:0.0:1788746145.392220:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163459584:12345-0@lo:501: Request processed in 2983us (7552us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746145.392242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746145.392473:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459584:0@lo:501: 10000000:01000000:2.0:1788746145.392509:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788746145.392561:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788746145.392576:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.392587:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.392595:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.392630:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788746145.392655:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd47ebce000 10000000:01000000:2.0:1788746145.392660:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788746145.392665:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788746145.392668:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788746145.392671:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788746145.392674:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788746145.392714:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.392722:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.392733:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.392751:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459712:0@lo:101: 00000100:00100000:2.0:1788746145.392789:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.392838:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83480 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.392947:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459712 00000100:00100000:3.0:1788746145.392962:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459712 00000100:00100000:3.0:1788746145.393020:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746145.393039:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163459712:12345-0@lo:101: 00010000:00010000:3.0:1788746145.393053:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746145.393073:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309820 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.393110:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309820 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.393128:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309820 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.393137:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b400, rc 0) 00000100:00100000:3.0:1788746145.393193:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163459712:12345-0@lo:101: Request processed in 164us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.393202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788746145.393544:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459712:0@lo:101: 00010000:00010000:2.0:1788746145.393565:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.393578:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.393692:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459840:0@lo:501: 00000100:00100000:2.0:1788746145.393729:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.393759:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83480 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.393820:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459840 00000100:00100000:1.0:1788746145.393825:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459840 00000100:00100000:1.0:1788746145.393876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746145.393884:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163459840:12345-0@lo:501: 00000100:00100000:1.0:1788746145.394157:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163459840:12345-0@lo:501: Request processed in 270us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.394168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1788746145.394516:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746145.394523:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394531:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44e00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746145.394534:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394549:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746145.394557:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746145.394562:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746145.394583:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394589:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746145.394627:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394634:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f44e00/0xe59b64da5b309812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe59b64da5b309819 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394647:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746145.394649:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746145.394651:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746145.394692:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746145.394704:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163459968:0@lo:103: 00000100:00100000:1.0:1788746145.394735:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.394808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163459968 00000100:00100000:0.0:1788746145.394813:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163459968 00000100:00100000:0.0:1788746145.394851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746145.394860:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3315:x1875636163459968:12345-0@lo:103: 00010000:00010000:0.0:1788746145.394868:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746145.394880:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309812 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.394892:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746145.394926:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3315:x1875636163459968:12345-0@lo:103: Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.394933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746145.395007:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163459840:0@lo:501: 00000100:00100000:2.0:1788746145.395038:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460096:0@lo:503: 00000100:00100000:2.0:1788746145.395075:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746145.395097:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83480 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.395438:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163459968:0@lo:103: 00000100:00100000:0.0:1788746145.395845:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460096 00000100:00100000:0.0:1788746145.395851:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460096 00000100:00100000:0.0:1788746145.395894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788746145.395902:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460096:12345-0@lo:503: 00000100:00100000:0.0:1788746145.396096:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460096:12345-0@lo:503: Request processed in 193us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.396103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746145.396485:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460096:0@lo:503: 00000040:00080000:3.0:1788746145.396771:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746145.396837:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460224:0@lo:502: 00000100:00100000:3.0:1788746145.396897:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.396934:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746145.396995:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460224 00000100:00100000:2.0:1788746145.397000:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460224 00000100:00100000:2.0:1788746145.397041:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788746145.397047:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460224:12345-0@lo:502: 00000100:00100000:2.0:1788746145.397230:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460224:12345-0@lo:502: Request processed in 182us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.397236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746145.401921:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460224:0@lo:502: 00000040:00080000:3.0:1788746145.402246:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788746145.402322:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788746145.402359:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788746145.402481:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788746145.402527:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788746145.402566:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788746145.402620:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460352:0@lo:502: 00000100:00100000:3.0:1788746145.402696:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.402733:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.402854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460352 00000100:00100000:0.0:1788746145.402862:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460352 00000100:00100000:0.0:1788746145.402905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788746145.402915:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460352:12345-0@lo:502: 00000100:00100000:0.0:1788746145.403093:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460352:12345-0@lo:502: Request processed in 178us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.403102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788746145.403626:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460352:0@lo:502: 00000040:00080000:3.0:1788746145.403743:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788746145.403754:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788746145.405780:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788746145.405791:0:7627:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788746145.405799:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746145.405802:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788746145.405808:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746145.405823:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cd45fbbcd40) 00000020:00000080:3.0:1788746145.405847:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788746145.405852:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788746145.405941:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd47ebce000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788746145.405949:0:7627:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788746145.405956:0:7627:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe59b64da5b309835 00010000:00010000:3.0:1788746145.415036:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788746145.415355:0:7627:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788746145.423826:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788746145.424146:0:7627:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788746145.433007:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788746145.433580:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788746145.435635:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788746145.435648:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746145.435655:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746145.435657:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788746145.435661:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746145.435665:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746145.435666:0:7627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788746145.435669:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788746145.435671:0:7627:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788746145.435723:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746145.435726:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746145.435728:0:7627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788746145.435731:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788746145.436640:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788746145.436676:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788746145.436700:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.436714:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746145.436723:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd47ebce000 from 1 10000000:01000000:3.0:1788746145.436726:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746145.436763:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.436771:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.436782:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.436804:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460480:0@lo:101: 00000100:00100000:3.0:1788746145.436870:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.438143:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4511996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.446882:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460480 00000100:00100000:1.0:1788746145.446896:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460480 00000100:00100000:1.0:1788746145.446955:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788746145.446965:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+12:7620:x1875636163460480:12345-0@lo:101: 00010000:00010000:1.0:1788746145.446980:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746145.446997:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30983c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.447025:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30983c expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.447036:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30983c expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.447045:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479800, rc 0) 00000100:00100000:1.0:1788746145.447115:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460480:12345-0@lo:101: Request processed in 152us (10245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.447132:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788746145.447784:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460480:0@lo:101: 00010000:00010000:0.0:1788746145.447803:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.447814:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746145.447946:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460608:0@lo:501: 00000100:00100000:0.0:1788746145.447991:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.448033:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.448151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460608 00000100:00100000:3.0:1788746145.448158:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460608 00000100:00100000:3.0:1788746145.448201:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788746145.448210:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460608:12345-0@lo:501: 00000100:00100000:3.0:1788746145.448484:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460608:12345-0@lo:501: Request processed in 275us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.448492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788746145.448542:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460608:0@lo:501: 00000100:00100000:3.0:1788746145.448573:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460736:0@lo:503: 00000100:00100000:3.0:1788746145.448787:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.448809:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4511996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.448824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460736 00000100:00100000:3.0:1788746145.448828:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460736 00000100:00100000:3.0:1788746145.448853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788746145.448861:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460736:12345-0@lo:503: 00000100:00100000:3.0:1788746145.449229:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460736:12345-0@lo:503: Request processed in 367us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.449236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788746145.450122:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460736:0@lo:503: 00000040:00080000:3.0:1788746145.450490:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746145.450570:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460864:0@lo:502: 00000100:00100000:3.0:1788746145.452491:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.452534:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4511996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.452565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460864 00000100:00100000:3.0:1788746145.452572:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460864 00000100:00100000:3.0:1788746145.453000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788746145.453010:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460864:12345-0@lo:502: 00000100:00100000:3.0:1788746145.453248:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460864:12345-0@lo:502: Request processed in 239us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.453691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788746145.453760:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460864:0@lo:502: 00000040:00080000:3.0:1788746145.454870:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788746145.455014:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788746145.455053:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460992:0@lo:502: 00000100:00100000:3.0:1788746145.455110:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.455188:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4511996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.464057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163460992 00000100:00100000:0.0:1788746145.464070:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163460992 00000100:00100000:0.0:1788746145.464133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788746145.464143:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460992:12345-0@lo:502: 00000100:00100000:0.0:1788746145.464547:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163460992:12345-0@lo:502: Request processed in 404us (9435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.464556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788746145.465283:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163460992:0@lo:502: 00000040:00080000:1.0:1788746145.465482:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788746145.465496:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788746145.466511:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746145.466523:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746145.466525:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788746145.466532:0:7631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd47ebce000 00000020:00000080:3.0:1788746145.466535:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746145.466555:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746145.466558:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746145.466559:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788746145.466562:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788746145.466871:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788746145.466907:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746145.466926:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.466937:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746145.466988:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788746145.466992:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd47ebce000 10000000:01000000:0.0:1788746145.466994:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd47ebce000 10000000:01000000:0.0:1788746145.466999:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746145.467015:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd47ebce000 from 1 10000000:01000000:0.0:1788746145.467018:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746145.467052:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.467059:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.467069:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746145.467089:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461120:0@lo:101: 00000100:00100000:0.0:1788746145.467150:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.467192:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd447ce8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.467507:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461120 00000100:00100000:1.0:1788746145.467514:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461120 00000100:00100000:1.0:1788746145.467565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788746145.467574:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163461120:12345-0@lo:101: 00010000:00010000:1.0:1788746145.467595:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746145.467618:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30984a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.467639:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30984a expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.467647:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30984a expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.467657:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479200, rc 0) 00000100:00100000:1.0:1788746145.467697:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461120:12345-0@lo:101: Request processed in 124us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.467702:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788746145.467991:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461120:0@lo:101: 00010000:00010000:0.0:1788746145.468007:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.468016:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746145.468111:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461248:0@lo:501: 00000100:00100000:0.0:1788746145.468143:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.468178:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd447ce8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746145.468362:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461248 00000100:00100000:1.0:1788746145.468367:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461248 00000100:00100000:1.0:1788746145.468426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788746145.468435:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461248:12345-0@lo:501: 00000100:00100000:1.0:1788746145.469033:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461248:12345-0@lo:501: Request processed in 597us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.469049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746145.469823:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461248:0@lo:501: 00000100:00100000:0.0:1788746145.469869:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461376:0@lo:503: 00000100:00100000:0.0:1788746145.470036:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.470130:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd447ce8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746145.472796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461376 00000100:00100000:2.0:1788746145.472809:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461376 00000100:00100000:2.0:1788746145.473041:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788746145.473055:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461376:12345-0@lo:503: 00000100:00100000:2.0:1788746145.473316:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461376:12345-0@lo:503: Request processed in 265us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.473387:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461376:0@lo:503: 00000040:00080000:0.0:1788746145.473732:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788746145.473812:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461504:0@lo:502: 00000100:00100000:0.0:1788746145.473859:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.473908:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.474254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461504 00000100:00100000:3.0:1788746145.474279:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461504 00000100:00100000:2.0:1788746145.475694:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788746145.476076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788746145.476093:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461504:12345-0@lo:502: 00000100:00100000:3.0:1788746145.476794:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461504:12345-0@lo:502: Request processed in 706us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.476803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788746145.476907:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461504:0@lo:502: 00000040:00080000:0.0:1788746145.477199:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788746145.477254:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788746145.477308:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788746145.477355:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788746145.477392:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788746145.477476:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788746145.477506:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788746145.477535:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788746145.477573:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788746145.477625:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788746145.477655:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788746145.477710:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788746145.477744:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788746145.477772:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788746145.477812:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788746145.477839:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788746145.477865:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788746145.477905:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788746145.477935:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788746145.477959:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788746145.478007:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788746145.478052:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788746145.478080:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788746145.478123:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788746145.478167:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788746145.478198:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788746145.478245:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788746145.478279:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788746145.478311:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788746145.478357:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788746145.478393:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788746145.478457:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788746145.478490:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788746145.478533:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788746145.478566:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788746145.478637:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788746145.478679:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788746145.478720:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461632:0@lo:502: 00000100:00100000:0.0:1788746145.478781:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746145.487878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461632 00000100:00100000:1.0:1788746145.487893:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461632 00000100:00100000:1.0:1788746145.487956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788746145.487967:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461632:12345-0@lo:502: 00000100:00100000:1.0:1788746145.488253:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461632:12345-0@lo:502: Request processed in 287us (9470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.488463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788746145.490109:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.490160:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461632:0@lo:502: 00000040:00080000:0.0:1788746145.490340:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788746145.490357:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788746145.500937:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788746145.500955:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cd4475119c0) 00000020:00000080:2.0:1788746145.500976:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788746145.501072:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd47ebce000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788746145.501076:0:7632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd47ebce000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788746145.501079:0:7632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd47ebce000 3 00010000:00080000:2.0:1788746145.501107:0:7632:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd45f4f6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.124@tcp at head 00010000:00010000:2.0:1788746145.504996:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788746145.505236:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788746145.505289:0:7632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788746145.505304:0:7632:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe59b64da5b30985f 00000100:00080000:2.0:1788746145.505314:0:7632:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746145.505324:0:7632:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cd45f4f6800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:2.0:1788746145.505355:0:7632:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd47d08d180 x1875636163461760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788746145.505387:0:7632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788746145.506759:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163461760:0@lo:38: 00000100:00100000:0.0:1788746145.506829:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.506902:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461760 00000100:00100000:0.0:1788746145.506910:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461760 00000100:00100000:0.0:1788746145.506942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746145.506948:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163461760:12345-0@lo:38: 00010000:00080000:0.0:1788746145.506973:0:5849:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1788746145.507006:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe59b64da5b309866 00000004:00100000:0.0:1788746145.507020:0:5849:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788746145.507053:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746145.507114:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875636163461760:12345-0@lo:38: Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.507122:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788746145.507161:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd47d08d180 x1875636163461760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746145.507170:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746145.507178:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788746145.507185:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788746145.507189:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788746145.507192:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788746145.507197:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163461760:0@lo:38: 00000040:00080000:2.0:1788746145.509969:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788746145.510109:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788746145.510137:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788746145.510160:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.510172:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788746145.510214:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788746145.510216:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746145.510218:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746145.510219:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746145.510220:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746145.510221:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746145.510223:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746145.510224:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746145.510226:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746145.510227:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746145.510229:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788746145.510232:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788746145.510238:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746145.510240:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746145.510240:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746145.510241:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746145.510242:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746145.510243:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746145.510244:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746145.510245:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746145.510246:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746145.510247:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746145.510247:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788746145.510289:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788746145.510307:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461888:0@lo:253: 00000100:00100000:0.0:1788746145.510372:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.510432:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c27000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.510481:0:7633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1875636163462016:0@lo:901: 00000100:00100000:0.0:1788746145.510523:0:7633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.510543:0:7633:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd447ce8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746145.510926:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462016 00000100:00100000:3.0:1788746145.510934:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462016 00000100:00100000:3.0:1788746145.510995:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746145.511005:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875636163462016:12345-0@lo:901: 00000100:00100000:3.0:1788746145.511378:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875636163462016:12345-0@lo:901: Request processed in 374us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746145.511392:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788746145.511466:0:7633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd44626b100 x1875636163462016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788746161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746145.511479:0:7633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1875636163462016:0@lo:901: 00000100:00100000:1.0:1788746145.512069:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163461888 00000100:00100000:1.0:1788746145.512077:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163461888 00000100:00100000:1.0:1788746145.512119:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788746145.512127:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:7620:x1875636163461888:12345-0@lo:253: 20000000:01000000:1.0:1788746145.512150:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788746145.512163:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788746145.513529:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163462144:0@lo:400: 00000100:00100000:1.0:1788746145.513585:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746145.513646:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462144 00000100:00100000:1.0:1788746145.513652:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462144 00000100:00100000:1.0:1788746145.513687:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746145.513694:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163462144:12345-0@lo:400: 00000100:00100000:1.0:1788746145.513736:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163462144:12345-0@lo:400: Request processed in 42us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.513742:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788746145.513777:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdce00 x1875636163462144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746145.513790:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163462144:0@lo:400: 00000100:00100000:1.0:1788746145.513839:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163462272:0@lo:400: 00000100:00100000:1.0:1788746145.513864:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746145.513893:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462272 00000100:00100000:1.0:1788746145.513897:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462272 00000100:00100000:1.0:1788746145.513925:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746145.513932:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163462272:12345-0@lo:400: 00000100:00100000:1.0:1788746145.513966:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163462272:12345-0@lo:400: Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.513972:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788746145.513998:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdce00 x1875636163462272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746145.514008:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163462272:0@lo:400: 00000100:00100000:1.0:1788746145.514038:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163462400:0@lo:400: 00000100:00100000:1.0:1788746145.514065:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746145.514094:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462400 00000100:00100000:1.0:1788746145.514098:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462400 00000100:00100000:1.0:1788746145.514127:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746145.514134:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163462400:12345-0@lo:400: 00000100:00100000:1.0:1788746145.514168:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163462400:12345-0@lo:400: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746145.514173:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788746145.514199:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd476fdce00 x1875636163462400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746145.514209:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163462400:0@lo:400: 00000100:00080000:0.0:1788746145.516360:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746145.516368:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1788746145.561298:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788746145.561321:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788746145.561382:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788746145.561387:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788746145.561430:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.561447:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.561455:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.561489:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746145.561502:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 14 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746145.561524:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163462528:0@lo:104: 00000100:00100000:3.0:1788746145.561585:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746145.561640:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477679b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746145.561821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462528 00000100:00100000:0.0:1788746145.561828:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462528 00000100:00100000:0.0:1788746145.561873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746145.561881:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163462528:12345-0@lo:104: 00010000:00010000:0.0:1788746145.561892:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.561939:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788746145.561945:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:5865:x1875636163462528:12345-0@lo:104: Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746145.561952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788746145.561983:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746145.561988:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.561996:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746145.562000:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.562008:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746145.562014:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746145.562020:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746145.562041:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.562048:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746145.562063:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.562069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3097b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3097be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746145.562084:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746145.562085:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746145.562087:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746145.562097:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163462656:0@lo:103: 00000100:00100000:0.0:1788746145.562126:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746145.562189:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875636163462528:0@lo:104: 00010000:00010000:0.0:1788746145.562212:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.562355:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462656 00000100:00100000:2.0:1788746145.562360:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462656 00010000:00010000:2.0:1788746145.562379:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 15 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.562434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788746145.562441:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:3314:x1875636163462656:12345-0@lo:103: 00010000:00010000:2.0:1788746145.562451:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746145.562456:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 15 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562465:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 15 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562477:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3097be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3097b7 expref: 15 pid: 5844 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562487:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562494:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788746145.562506:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004589680s 00010000:00010000:2.0:1788746145.562522:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562529:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562541:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562548:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562553:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09a600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746145.562556:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562563:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562580:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746145.562590:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746145.562637:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:3314:x1875636163462656:12345-0@lo:103: Request processed in 196us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.562643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788746145.562695:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163462656:0@lo:103: 00010000:00010000:1.0:1788746145.564442:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.564472:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746145.564479:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30986d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746145.587101:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:7620:x1875636163461888:12345-0@lo:253: Request processed in 74965us (76720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746145.587115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788746145.587358:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85baee7e-e9e8-492f-b3b0-167696ca895f:7620:1875636163461888:0@lo:253: 10000000:01000000:0.0:1788746145.587374:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788746145.587378:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746145.587380:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746145.587381:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746145.587382:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746145.587383:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746145.587384:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746145.587386:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746145.587387:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788746145.587388:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788746145.587390:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746145.587391:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788746145.587435:0:7620:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788746145.598877:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746145.599083:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746145.599867:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746145.600078:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746145.601435:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746145.601793:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788746145.605126:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788746145.865941:0:7620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788746145.865948:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788746145.865975:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788746145.866026:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788746145.866044:0:7620:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788746145.866077:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788746146.299452:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746147.260808:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746147.260843:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163462784:0@lo:13: 00000100:00100000:2.0:1788746147.260928:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746147.261026:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462784 00000100:00100000:2.0:1788746147.261035:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462784 00000100:00100000:2.0:1788746147.261107:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788746147.261117:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163462784:12345-0@lo:13: 00002000:00000024:2.0:1788746147.261154:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746147.261201:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163462784:12345-0@lo:13: Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746147.261208:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788746147.261271:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08fb80 x1875636163462784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746147.261292:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163462784:0@lo:13: 00000100:00080000:0.0:1788746147.262467:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788746147.324506:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746148.347972:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746149.375795:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746150.395795:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746150.843595:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163463168:0@lo:400: 00000100:00100000:3.0:1788746150.843663:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746150.843717:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746150.843724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163463296:0@lo:400: 00000100:00100000:3.0:1788746150.843749:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746150.843903:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163462912:0@lo:400: 00000100:00100000:1.0:1788746150.843937:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746150.843969:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163463424:0@lo:400: 00000100:00100000:1.0:1788746150.843995:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746150.844014:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746150.844019:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163463040:0@lo:400: 00000100:00100000:1.0:1788746150.844038:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746150.844065:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463168 00000100:00100000:1.0:1788746150.844071:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463168 00000100:00100000:1.0:1788746150.844111:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463424 00000100:00100000:1.0:1788746150.844113:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463424 00000100:00100000:1.0:1788746150.844124:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463040 00000100:00100000:1.0:1788746150.844126:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463040 00000100:00100000:1.0:1788746150.844139:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746150.844146:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163463168:12345-0@lo:400: 00000100:00100000:1.0:1788746150.844204:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163463168:12345-0@lo:400: Request processed in 58us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746150.844211:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746150.844227:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746150.844233:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163463424:12345-0@lo:400: 00000100:00100000:1.0:1788746150.844260:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163463424:12345-0@lo:400: Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746150.844266:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746150.844277:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746150.844282:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163463040:12345-0@lo:400: 00000100:00100000:1.0:1788746150.844307:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163463040:12345-0@lo:400: Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746150.844313:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746150.844330:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463296 00000100:00100000:1.0:1788746150.844334:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463296 00000100:00100000:1.0:1788746150.844358:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746150.844365:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163463296:12345-0@lo:400: 00000100:00100000:1.0:1788746150.844393:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163463296:12345-0@lo:400: Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746150.844422:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788746150.844463:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0e00 x1875636163463040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746150.844477:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163463040:0@lo:400: 00010000:00080000:1.0:1788746150.844487:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d1500 x1875636163463424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746150.844504:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163463424:0@lo:400: 00010000:00080000:1.0:1788746150.844535:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0700 x1875636163463296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746150.844543:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163463296:0@lo:400: 00010000:00080000:1.0:1788746150.844631:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d3800 x1875636163463168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746150.844640:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163463168:0@lo:400: 00000100:00080000:0.0:1788746150.844785:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746150.844790:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746150.844847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163462912 00000100:00100000:3.0:1788746150.844853:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163462912 00000100:00100000:3.0:1788746150.844888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788746150.844898:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3316:x1875636163462912:12345-0@lo:400: 00000100:00100000:3.0:1788746150.844933:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3316:x1875636163462912:12345-0@lo:400: Request processed in 38us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746150.844939:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788746150.845049:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163462912:0@lo:400: 00010000:00010000:0.0:1788746151.421693:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746152.378557:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163463552:0@lo:13: 00000100:00100000:1.0:1788746152.378656:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746152.378971:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463552 00000100:00100000:1.0:1788746152.378979:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463552 00000100:00100000:1.0:1788746152.379037:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746152.379046:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163463552:12345-0@lo:13: 00002000:00000024:1.0:1788746152.379079:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746152.379123:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163463552:12345-0@lo:13: Request processed in 77us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746152.379129:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788746152.379169:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08fb80 x1875636163463552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746152.379185:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163463552:0@lo:13: 00000100:00080000:2.0:1788746152.379244:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788746152.443540:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746153.046810:0:7975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788746153.467468:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788746154.426512:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788746154.426520:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448dea800 from 30 10000000:01000000:2.0:1788746154.426525:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788746154.426585:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.426597:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.426608:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746154.426633:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463680:0@lo:101: 00000100:00100000:2.0:1788746154.426823:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746154.426976:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.427052:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463680 00000100:00100000:1.0:1788746154.427060:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463680 00000100:00100000:1.0:1788746154.427121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788746154.427130:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163463680:12345-0@lo:101: 00010000:00010000:1.0:1788746154.427142:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746154.427154:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309874 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.427176:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309874 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.427187:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309874 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.427195:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479c00, rc 0) 00000100:00100000:1.0:1788746154.427243:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163463680:12345-0@lo:101: Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.427250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788746154.427354:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463680:0@lo:101: 00010000:00010000:0.0:1788746154.427370:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.427379:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746154.427642:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463808:0@lo:501: 00000100:00100000:0.0:1788746154.427682:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.427781:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44521b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.427840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463808 00000100:00100000:1.0:1788746154.427845:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463808 00000100:00100000:1.0:1788746154.427962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788746154.427971:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163463808:12345-0@lo:501: 00000100:00100000:1.0:1788746154.428319:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163463808:12345-0@lo:501: Request processed in 348us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.428326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788746154.428361:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463808:0@lo:501: 00000100:00100000:1.0:1788746154.428425:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463936:0@lo:503: 00000100:00100000:1.0:1788746154.431921:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.431971:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746154.432471:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163463936 00000100:00100000:2.0:1788746154.432481:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163463936 00000100:00100000:2.0:1788746154.432538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788746154.432549:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163463936:12345-0@lo:503: 00000100:00100000:2.0:1788746154.432924:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163463936:12345-0@lo:503: Request processed in 376us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746154.432932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788746154.432994:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163463936:0@lo:503: 00000100:00100000:0.0:1788746154.438905:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8050:1875636163464064:0@lo:502: 00000100:00100000:0.0:1788746154.438991:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.439028:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44ff61240 going to sleep for 11 seconds 00000100:00100000:2.0:1788746154.439212:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464064 00000100:00100000:2.0:1788746154.439219:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464064 00000100:00100000:2.0:1788746154.439269:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788746154.443427:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8050:x1875636163464064:12345-0@lo:502: 00000100:00100000:3.0:1788746154.443998:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8050:x1875636163464064:12345-0@lo:502: Request processed in 4716us (5002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.444010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788746154.445222:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8050:1875636163464064:0@lo:502: 00000100:00100000:0.0:1788746154.445319:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8050:1875636163464192:0@lo:502: 00000100:00100000:0.0:1788746154.445381:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.445449:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746154.446935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464192 00000100:00100000:2.0:1788746154.446946:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464192 00000100:00100000:2.0:1788746154.447005:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788746154.447016:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8050:x1875636163464192:12345-0@lo:502: 00000100:00100000:2.0:1788746154.447303:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8050:x1875636163464192:12345-0@lo:502: Request processed in 289us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746154.447311:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788746154.448284:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8050:1875636163464192:0@lo:502: 00000040:00080000:0.0:1788746154.448329:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788746154.448837:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788746154.448860:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788746154.448870:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.448882:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746154.448912:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788746154.448914:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788746154.448917:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788746154.448975:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.448984:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.448994:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746154.449016:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464320:0@lo:101: 00000100:00100000:2.0:1788746154.449076:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746154.449120:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.450855:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464320 00000100:00100000:0.0:1788746154.450867:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464320 00000100:00100000:0.0:1788746154.450929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788746154.450939:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163464320:12345-0@lo:101: 00010000:00010000:0.0:1788746154.450953:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746154.450970:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309882 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.450995:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309882 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.451005:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309882 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.451014:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031c00, rc 0) 00000100:00100000:0.0:1788746154.451085:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464320:12345-0@lo:101: Request processed in 148us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746154.451102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788746154.451156:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464320:0@lo:101: 00010000:00010000:0.0:1788746154.451174:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.451182:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746154.451246:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464448:0@lo:501: 00000100:00100000:0.0:1788746154.451278:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.451305:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4457949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.451776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464448 00000100:00100000:3.0:1788746154.451783:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464448 00000100:00100000:3.0:1788746154.451814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788746154.451822:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464448:12345-0@lo:501: 00000100:00100000:3.0:1788746154.452056:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464448:12345-0@lo:501: Request processed in 235us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.452064:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788746154.452101:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464448:0@lo:501: 00000100:00100000:3.0:1788746154.452137:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464576:0@lo:503: 00000100:00100000:3.0:1788746154.452183:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.452205:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.452216:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464576 00000100:00100000:3.0:1788746154.452219:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464576 00000100:00100000:3.0:1788746154.452240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788746154.452244:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464576:12345-0@lo:503: 00000100:00100000:3.0:1788746154.455023:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464576:12345-0@lo:503: Request processed in 2769us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.455036:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788746154.456763:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464576:0@lo:503: 00000100:00100000:0.0:1788746154.456948:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8051:1875636163464704:0@lo:502: 00000100:00100000:0.0:1788746154.457006:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.457035:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.457225:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464704 00000100:00100000:3.0:1788746154.457232:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464704 00000100:00100000:3.0:1788746154.457267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788746154.457274:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8051:x1875636163464704:12345-0@lo:502: 00000100:00100000:3.0:1788746154.457536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8051:x1875636163464704:12345-0@lo:502: Request processed in 261us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.457544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788746154.458687:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8051:1875636163464704:0@lo:502: 00000020:01000000:0.0:1788746154.458729:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746154.458738:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746154.458741:0:8051:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788746154.458745:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788746154.458746:0:8051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788746154.458773:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8051:1875636163464832:0@lo:502: 00000100:00100000:0.0:1788746154.458827:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.458859:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.459210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464832 00000100:00100000:3.0:1788746154.459217:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464832 00000100:00100000:3.0:1788746154.459261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788746154.459268:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8051:x1875636163464832:12345-0@lo:502: 00000100:00100000:3.0:1788746154.459496:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8051:x1875636163464832:12345-0@lo:502: Request processed in 226us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.459503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788746154.459601:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8051:1875636163464832:0@lo:502: 00000020:01000000:1.0:1788746154.459634:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746154.459640:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746154.459642:0:8051:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788746154.459646:0:8051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788746154.462088:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788746154.462126:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788746154.462138:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.462167:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746154.462176:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788746154.462179:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448caf000 from 30 10000000:01000000:3.0:1788746154.462182:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788746154.462217:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.462226:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.462236:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746154.462261:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464960:0@lo:101: 00000100:00100000:3.0:1788746154.462498:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.462543:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.462887:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163464960 00000100:00100000:0.0:1788746154.462894:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163464960 00000100:00100000:0.0:1788746154.462947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788746154.462957:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163464960:12345-0@lo:101: 00010000:00010000:0.0:1788746154.462970:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746154.462985:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309890 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.463009:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309890 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.463018:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309890 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.463025:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031e00, rc 0) 00000100:00100000:0.0:1788746154.463068:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163464960:12345-0@lo:101: Request processed in 113us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746154.463075:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788746154.463500:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163464960:0@lo:101: 00010000:00010000:3.0:1788746154.463516:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.463524:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746154.463624:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465088:0@lo:501: 00000100:00100000:3.0:1788746154.463655:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.463700:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.463714:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465088 00000100:00100000:3.0:1788746154.463718:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465088 00000100:00100000:3.0:1788746154.463755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788746154.463762:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163465088:12345-0@lo:501: 00000100:00100000:3.0:1788746154.463998:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163465088:12345-0@lo:501: Request processed in 236us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.464005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788746154.464038:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465088:0@lo:501: 00000100:00100000:3.0:1788746154.464065:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465216:0@lo:503: 00000100:00100000:3.0:1788746154.464100:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.464114:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.464125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465216 00000100:00100000:3.0:1788746154.464129:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465216 00000100:00100000:3.0:1788746154.464146:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788746154.464151:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163465216:12345-0@lo:503: 00000100:00100000:3.0:1788746154.464282:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163465216:12345-0@lo:503: Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.464289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788746154.464323:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465216:0@lo:503: 00000100:00100000:3.0:1788746154.464532:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8053:1875636163465344:0@lo:502: 00000100:00100000:3.0:1788746154.464583:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.464602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465344 00000100:00100000:3.0:1788746154.464605:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465344 00000100:00100000:3.0:1788746154.464624:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788746154.464630:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8053:x1875636163465344:12345-0@lo:502: 00000100:00100000:3.0:1788746154.464782:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8053:x1875636163465344:12345-0@lo:502: Request processed in 151us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.464789:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788746154.464824:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.464837:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8053:1875636163465344:0@lo:502: 00000100:00100000:3.0:1788746154.464875:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8053:1875636163465472:0@lo:502: 00000100:00100000:3.0:1788746154.464908:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.464926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465472 00000100:00100000:3.0:1788746154.464930:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465472 00000100:00100000:3.0:1788746154.464946:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788746154.464952:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8053:x1875636163465472:12345-0@lo:502: 00000100:00100000:3.0:1788746154.465071:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8053:x1875636163465472:12345-0@lo:502: Request processed in 119us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.465079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788746154.465106:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44448e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.465118:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8053:1875636163465472:0@lo:502: 00000040:00080000:3.0:1788746154.465137:0:8053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788746154.465186:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788746154.465201:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788746154.465210:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465219:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746154.465228:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788746154.465236:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448caf000 from 5 10000000:01000000:3.0:1788746154.465238:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788746154.465262:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465271:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465279:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746154.465292:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465600:0@lo:101: 00000100:00100000:3.0:1788746154.465317:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.465331:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44448e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.465343:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465600 00000100:00100000:3.0:1788746154.465346:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465600 00000100:00100000:3.0:1788746154.465363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788746154.465369:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163465600:12345-0@lo:101: 00010000:00010000:3.0:1788746154.465377:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746154.465430:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f941000/0xe59b64da5b3098a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30989e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465453:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f941000/0xe59b64da5b3098a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30989e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465463:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f941000/0xe59b64da5b3098a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30989e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465471:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941000, rc 0) 00000100:00100000:3.0:1788746154.465499:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163465600:12345-0@lo:101: Request processed in 130us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746154.465511:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788746154.465544:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465600:0@lo:101: 00010000:00010000:3.0:1788746154.465963:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746154.465975:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746154.466023:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465728:0@lo:256: 00000100:00100000:3.0:1788746154.466056:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.466128:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44448e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.468934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465728 00000100:00100000:0.0:1788746154.468949:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465728 00000100:00100000:0.0:1788746154.469006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788746154.469017:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163465728:12345-0@lo:256: 20000000:01000000:0.0:1788746154.469040:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788746154.469056:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788746154.469059:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788746154.469182:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163465728:12345-0@lo:256: Request processed in 166us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746154.469189:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788746154.469239:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465728:0@lo:256: 10000000:01000000:0.0:1788746154.469289:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788746154.469302:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.470795:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746154.470807:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788746154.470810:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788746154.470813:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788746154.470851:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.470858:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.470868:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746154.470890:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465856:0@lo:101: 00000100:00100000:0.0:1788746154.470953:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.471001:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4457949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.471068:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465856 00000100:00100000:1.0:1788746154.471075:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465856 00000100:00100000:1.0:1788746154.471122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788746154.471132:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163465856:12345-0@lo:101: 00010000:00010000:1.0:1788746154.471143:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746154.471155:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3098ac expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.471177:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.471187:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.471195:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478c00, rc 0) 00000100:00100000:1.0:1788746154.471235:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163465856:12345-0@lo:101: Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.471241:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788746154.471296:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465856:0@lo:101: 00010000:00010000:1.0:1788746154.471319:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746154.471328:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746154.471420:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465984:0@lo:501: 00000100:00100000:1.0:1788746154.471455:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.471469:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95540 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.471482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163465984 00000100:00100000:1.0:1788746154.471485:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163465984 00000100:00100000:1.0:1788746154.471508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788746154.471514:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163465984:12345-0@lo:501: 00000100:00100000:1.0:1788746154.471890:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163465984:12345-0@lo:501: Request processed in 375us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.471897:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788746154.471944:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163465984:0@lo:501: 00000100:00100000:1.0:1788746154.471970:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163466112:0@lo:503: 00000100:00100000:1.0:1788746154.472010:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.472023:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261180 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.472033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466112 00000100:00100000:1.0:1788746154.472037:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466112 00000100:00100000:1.0:1788746154.472053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788746154.472059:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163466112:12345-0@lo:503: 00000100:00100000:1.0:1788746154.472912:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163466112:12345-0@lo:503: Request processed in 849us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.472921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788746154.472973:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163466112:0@lo:503: 00000100:00100000:1.0:1788746154.473156:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8054:1875636163466240:0@lo:502: 00000100:00100000:1.0:1788746154.473196:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.473229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466240 00000100:00100000:1.0:1788746154.473234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466240 00000100:00100000:1.0:1788746154.473259:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788746154.473266:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8054:x1875636163466240:12345-0@lo:502: 00000100:00100000:0.0:1788746154.476488:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd3452613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.476518:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8054:1875636163466240:0@lo:502: 00000020:01000000:0.0:1788746154.476570:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788746154.476578:0:8054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788746154.476586:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746154.476589:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788746154.476594:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788746154.476598:0:8054:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.124@tcp to nid 0x20000c0a8ce7c (192.168.206.124@tcp) 00000020:01000000:0.0:1788746154.476618:0:8054:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788746154.476628:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746154.476644:0:8054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cd4462719c0) 00000100:00100000:1.0:1788746154.476913:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8054:x1875636163466240:12345-0@lo:502: Request processed in 3037us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.476925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:00000080:0.0:1788746154.476997:0:8054:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788746154.477008:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788746154.477086:0:8054:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788746154.477092:0:8054:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788746154.477098:0:8054:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b3098c1 00010000:00080000:0.0:1788746154.477127:0:8054:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd476ff8800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:0.0:1788746154.477549:0:8054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788746154.479007:0:8054:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788746154.479025:0:8054:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788746154.480387:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746154.480687:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746154.482826:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788746154.482916:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788746154.489983:0:8055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746154.489992:0:8055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:2.0:1788746154.492661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788746154.497040:0:8054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788746154.497056:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788746154.497100:0:8054:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788746154.497125:0:8054:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b3098c8 00000100:00080000:1.0:1788746154.497136:0:8054:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746154.497146:0:8054:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd476ff8800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746154.497180:0:8054:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd476fdd180 x1875636163466368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746154.497273:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163466368:0@lo:8: 00000100:00100000:0.0:1788746154.497357:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.498986:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466368 00000100:00100000:1.0:1788746154.498998:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466368 00000100:00100000:1.0:1788746154.499045:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746154.499052:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1875636163466368:12345-0@lo:8: 00010000:00080000:1.0:1788746154.499082:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788746154.499108:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b3098cf 00002000:00100000:1.0:1788746154.499120:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cd476fff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788746154.499125:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788746154.499129:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788746154.499248:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788746154.499433:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788746154.499458:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47ebcc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746154.504562:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875636163466368:12345-0@lo:8: Request processed in 5488us (7185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.504577:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788746154.504620:0:8054:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788746154.504770:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163466496:0@lo:400: 00000100:00100000:1.0:1788746154.504823:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.504850:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746154.504857:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163466624:0@lo:400: 00000100:00100000:1.0:1788746154.504878:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.504902:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163466752:0@lo:400: 00000100:00100000:1.0:1788746154.504925:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.504942:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746154.504947:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163466880:0@lo:400: 00000100:00100000:1.0:1788746154.504967:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.504992:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466496 00000100:00100000:1.0:1788746154.504999:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466496 00000100:00100000:1.0:1788746154.505029:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466624 00000100:00100000:1.0:1788746154.505032:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466624 00000100:00100000:1.0:1788746154.505055:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466880 00000100:00100000:1.0:1788746154.505057:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466880 00000100:00100000:1.0:1788746154.505073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746154.505080:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163466496:12345-0@lo:400: 00000100:00100000:1.0:1788746154.505125:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163466496:12345-0@lo:400: Request processed in 46us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.505131:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746154.505144:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746154.505150:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163466624:12345-0@lo:400: 00000100:00100000:1.0:1788746154.505175:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163466624:12345-0@lo:400: Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.505189:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746154.505202:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746154.505208:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163466880:12345-0@lo:400: 00000100:00100000:1.0:1788746154.505241:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163466880:12345-0@lo:400: Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.505247:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746154.505268:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163466752 00000100:00100000:1.0:1788746154.505271:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163466752 00000100:00100000:1.0:1788746154.505295:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746154.505301:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163466752:12345-0@lo:400: 00000100:00100000:1.0:1788746154.505347:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163466752:12345-0@lo:400: Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.505353:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788746154.505371:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746154.505375:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788746154.505416:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f4e1180 x1875636163466880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.505429:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163466880:0@lo:400: 00010000:00080000:1.0:1788746154.505441:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd476fded80 x1875636163466752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.505448:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163466752:0@lo:400: 00010000:00080000:1.0:1788746154.505476:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd476fdf100 x1875636163466624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.505484:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163466624:0@lo:400: 00010000:00080000:1.0:1788746154.505494:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd476fdf480 x1875636163466496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.505508:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163466496:0@lo:400: 00000020:01000000:1.0:1788746154.505589:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746154.505597:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746154.505599:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788746154.505602:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746154.505606:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746154.505607:0:8054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788746154.505611:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788746154.505613:0:8054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788746154.505638:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8054:1875636163467008:0@lo:502: 00000100:00100000:1.0:1788746154.505678:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746154.505706:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf96c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788746154.512535:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd476fdd180 x1875636163466368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746154.512561:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746154.512572:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788746154.512580:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788746154.512586:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788746154.512589:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788746154.512604:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788746154.512610:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163466368:0@lo:8: 00000004:00080000:1.0:1788746154.512736:0:8055:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788746154.512899:0:8055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 228917499784ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788746154.519523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467008 00000100:00100000:2.0:1788746154.519539:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467008 00000100:00100000:2.0:1788746154.519607:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788746154.519617:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8054:x1875636163467008:12345-0@lo:502: 00000100:00100000:2.0:1788746154.520036:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8054:x1875636163467008:12345-0@lo:502: Request processed in 419us (14355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746154.520045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788746154.535972:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8054:1875636163467008:0@lo:502: 00000020:01000000:1.0:1788746154.536017:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746154.536025:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746154.536027:0:8054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788746154.536032:0:8054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788746154.538598:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788746154.538629:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788746154.538639:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.538662:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746154.538683:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788746154.538685:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cd445093380 from 1 10000000:01000000:2.0:1788746154.538688:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788746154.538899:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.538908:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746154.538919:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746154.538942:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163467136:0@lo:101: 00000100:00100000:2.0:1788746154.539005:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746154.539043:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb83a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.539179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467136 00000100:00100000:0.0:1788746154.539185:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467136 00000100:00100000:0.0:1788746154.539235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788746154.539251:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163467136:12345-0@lo:101: 00010000:00010000:0.0:1788746154.539262:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746154.539275:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3098d6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.539297:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.539306:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.539314:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031800, rc 0) 00000100:00100000:0.0:1788746154.539355:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163467136:12345-0@lo:101: Request processed in 105us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746154.539362:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788746154.539429:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163467136:0@lo:101: 00010000:00010000:0.0:1788746154.539454:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.539463:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746154.539509:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163467264:0@lo:501: 00000100:00100000:0.0:1788746154.539934:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.539962:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746154.539978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467264 00000100:00100000:0.0:1788746154.539982:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467264 00000100:00100000:0.0:1788746154.540010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788746154.540017:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163467264:12345-0@lo:501: 00000100:00100000:0.0:1788746154.540238:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163467264:12345-0@lo:501: Request processed in 219us (302us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746154.540245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788746154.540278:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163467264:0@lo:501: 10000000:01000000:0.0:1788746154.540302:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788746154.540309:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746154.540317:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746154.613541:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788746154.614336:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746154.614355:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163467392:0@lo:13: 00000100:00100000:0.0:1788746154.614448:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788746154.614498:0:8057:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788746154.614519:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467520:0@lo:7: 00000100:00100000:0.0:1788746154.614565:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.614581:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44448eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.614899:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467392 00000100:00100000:1.0:1788746154.614907:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467392 00000100:00100000:1.0:1788746154.614992:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746154.615001:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163467392:12345-0@lo:13: 00002000:00000024:1.0:1788746154.615033:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788746154.615096:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163467392:12345-0@lo:13: Request processed in 97us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.615103:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746154.615140:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467520 00000100:00100000:1.0:1788746154.615144:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467520 00000100:00080000:2.0:1788746154.615163:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746154.615169:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746154.615176:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8057:x1875636163467520:12345-0@lo:7: 00010000:00080000:2.0:1788746154.615513:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd44626b480 x1875636163467392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746154.615543:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163467392:0@lo:13: 00002000:00080000:1.0:1788746154.621327:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788746154.621335:0:6682:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788746154.621460:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8057:x1875636163467520:12345-0@lo:7: Request processed in 6279us (6889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746154.621471:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788746154.622039:0:8057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd446269180 x1875636163467520/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788746170 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746154.622054:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467520:0@lo:7: 00000004:00080000:0.0:1788746154.622067:0:8057:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788746154.622105:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467648:0@lo:5: 00000100:00100000:0.0:1788746154.622143:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746154.622171:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44448eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.622216:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467648 00000100:00100000:3.0:1788746154.622223:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467648 00000100:00100000:3.0:1788746154.622269:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746154.622278:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8057:x1875636163467648:12345-0@lo:5: 00002000:00080000:3.0:1788746154.622301:0:6681:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788746154.622305:0:6681:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788746154.623960:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8057:x1875636163467648:12345-0@lo:5: Request processed in 1677us (1811us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788746154.623972:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788746154.624196:0:8057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd446269180 x1875636163467648/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746170 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746154.624214:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467648:0@lo:5: 00000004:00080000:2.0:1788746154.624227:0:8057:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788746154.624275:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467776:0@lo:700: 00000100:00100000:2.0:1788746154.624321:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746154.624347:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd448741480 going to sleep for 11 seconds 00000100:00100000:3.0:1788746154.624969:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467776 00000100:00100000:3.0:1788746154.624977:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467776 00000100:00100000:3.0:1788746154.625030:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746154.625040:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8057:x1875636163467776:12345-0@lo:700: 00000100:00100000:3.0:1788746154.625081:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875636163467904:0@lo:700: 00000100:00100000:3.0:1788746154.625119:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.625156:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44311f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746154.625243:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163467904 00000100:00100000:2.0:1788746154.625248:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163467904 00000100:00100000:2.0:1788746154.625284:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746154.625292:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875636163467904:12345-0@lo:700: 40000000:02000000:3.0:1788746154.681010:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788746154.692499:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875636163467904:12345-0@lo:700: Request processed in 67199us (67371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746154.692513:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788746154.692643:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0a80 x1875636163467904/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788746170 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746154.692763:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875636163467904:0@lo:700: 40000000:02000000:3.0:1788746154.692777:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1788746154.846946:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8057:x1875636163467776:12345-0@lo:700: Request processed in 221899us (222616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746154.846973:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1788746154.847017:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788746154.847028:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1788746154.847102:0:8057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08c000 x1875636163467776/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788746170 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746154.847120:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163467776:0@lo:700: 00000004:02000040:0.0:1788746154.916168:0:8057:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788746154.927615:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163468032:0@lo:5: 00000100:00100000:3.0:1788746154.927791:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746154.927878:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746154.933864:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468032 00000100:00100000:1.0:1788746154.933881:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468032 00000100:00100000:1.0:1788746154.934003:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746154.934014:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8057:x1875636163468032:12345-0@lo:5: 00002000:00080000:0.0:1788746154.958728:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788746154.958746:0:6682:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788746154.968871:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8057:x1875636163468032:12345-0@lo:5: Request processed in 34852us (41073us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788746154.968884:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788746154.972499:0:8057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0a80 x1875636163468032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746170 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.972516:0:8057:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788746154.972828:0:8057:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cd4446d0a80 x1875636163468032/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746170 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746154.972840:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8057:1875636163468032:0@lo:5: 00000004:00080000:1.0:1788746154.972856:0:8057:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788746155.514850:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746156.538502:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746157.499857:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163468160:0@lo:13: 00000100:00100000:0.0:1788746157.499924:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746157.500101:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468160 00000100:00100000:2.0:1788746157.500109:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468160 00000100:00100000:2.0:1788746157.500166:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746157.500174:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163468160:12345-0@lo:13: 00002000:00000024:2.0:1788746157.500204:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746157.500254:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163468160:12345-0@lo:13: Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746157.500261:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788746157.500301:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08dc00 x1875636163468160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746157.500319:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163468160:0@lo:13: 00000100:00080000:0.0:1788746157.500552:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788746157.562630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746158.117236:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788746158.590335:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746158.654738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746158.654789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141424768 00000100:00100000:1.0:1788746158.654798:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141424768 00000100:00100000:1.0:1788746158.654837:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 111 00000100:00100000:1.0:1788746158.654845:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875636141424768:12345-192.168.206.24@tcp:250: 00010000:00080000:1.0:1788746158.654871:0:5844:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 44bb9cf7-174c-4b10-9126-e74b4487a571@192.168.206.24@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1788746158.654898:0:5844:0:(genops.c:1384:class_connect()) connect: client 44bb9cf7-174c-4b10-9126-e74b4487a571, cookie 0xe59b64da5b3098e4 00000100:00080000:1.0:1788746158.655017:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746158.655081:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+5:2346:x1875636141424768:12345-192.168.206.24@tcp:250: Request processed in 236us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746158.655089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 111 00000100:00100000:2.0:1788746158.656967:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.657134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141424896 00000100:00100000:0.0:1788746158.657143:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141424896 00000100:00100000:0.0:1788746158.657198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 112 00000100:00100000:0.0:1788746158.657209:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+5:5576:x1875636141424896:12345-192.168.206.24@tcp:101: 00010000:00010000:0.0:1788746158.657223:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746158.657240:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b0d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.657268:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.657279:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.657302:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440030e00, rc 0) 00000100:00100000:0.0:1788746158.657354:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+6:5576:x1875636141424896:12345-192.168.206.24@tcp:101: Request processed in 146us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.657361:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 112 00000100:00100000:3.0:1788746158.665663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.665708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425024 00000100:00100000:0.0:1788746158.665718:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425024 00000100:00100000:0.0:1788746158.665774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 113 00000100:00100000:0.0:1788746158.665786:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+6:5576:x1875636141425024:12345-192.168.206.24@tcp:501: 00000100:00100000:0.0:1788746158.666131:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+6:5576:x1875636141425024:12345-192.168.206.24@tcp:501: Request processed in 346us (475us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746158.666139:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 113 00000100:00100000:2.0:1788746158.667833:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.668386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425152 00000100:00100000:0.0:1788746158.668396:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425152 00000100:00100000:0.0:1788746158.668466:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:0.0:1788746158.668476:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+6:5576:x1875636141425152:12345-192.168.206.24@tcp:101: 00010000:00010000:0.0:1788746158.668490:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746158.668506:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b0dc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.668542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.668552:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746158.668560:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031a00, rc 0) 00000100:00100000:0.0:1788746158.668622:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+7:5576:x1875636141425152:12345-192.168.206.24@tcp:101: Request processed in 148us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.668629:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:3.0:1788746158.673559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.673774:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425280 00000100:00100000:0.0:1788746158.673784:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425280 00000100:00100000:0.0:1788746158.673846:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:0.0:1788746158.673856:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+7:5576:x1875636141425280:12345-192.168.206.24@tcp:501: 00000100:00100000:0.0:1788746158.674143:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5576:x1875636141425280:12345-192.168.206.24@tcp:501: Request processed in 287us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.674151:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:0.0:1788746158.693919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746158.693999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425408 00000100:00100000:2.0:1788746158.694010:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425408 00000100:00100000:2.0:1788746158.694071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:2.0:1788746158.694081:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5576:x1875636141425408:12345-192.168.206.24@tcp:503: 00000100:00100000:2.0:1788746158.694437:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5576:x1875636141425408:12345-192.168.206.24@tcp:503: Request processed in 356us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746158.694446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:0.0:1788746158.700325:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.700358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425536 00000100:00100000:0.0:1788746158.700367:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425536 00000100:00100000:0.0:1788746158.700427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:0.0:1788746158.700437:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5594:x1875636141425536:12345-192.168.206.24@tcp:502: 00000100:00100000:0.0:1788746158.700767:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5594:x1875636141425536:12345-192.168.206.24@tcp:502: Request processed in 331us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.700775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:3.0:1788746158.720299:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.720382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425664 00000100:00100000:0.0:1788746158.720393:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425664 00000100:00100000:0.0:1788746158.720460:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:0.0:1788746158.720470:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5594:x1875636141425664:12345-192.168.206.24@tcp:502: 00000100:00100000:0.0:1788746158.720756:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5594:x1875636141425664:12345-192.168.206.24@tcp:502: Request processed in 286us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.720764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:0.0:1788746158.727126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746158.727446:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425792 00000100:00100000:3.0:1788746158.727457:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425792 00000100:00100000:3.0:1788746158.727517:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:3.0:1788746158.727763:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5576:x1875636141425792:12345-192.168.206.24@tcp:101: 00010000:00010000:3.0:1788746158.727782:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746158.727800:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f941600/0xe59b64da5b3098f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b106 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.727827:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f941600/0xe59b64da5b3098f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b106 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.727857:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f941600/0xe59b64da5b3098f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b106 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.727865:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941600, rc 0) 00000100:00100000:3.0:1788746158.727929:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5576:x1875636141425792:12345-192.168.206.24@tcp:101: Request processed in 403us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746158.727937:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:1.0:1788746158.734366:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746158.734523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141425920 00000100:00100000:3.0:1788746158.734543:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141425920 00000100:00100000:3.0:1788746158.734603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:3.0:1788746158.734613:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5576:x1875636141425920:12345-192.168.206.24@tcp:256: 20000000:01000000:3.0:1788746158.734635:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788746158.734667:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788746158.734671:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788746158.734674:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788746158.734676:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788746158.743497:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5576:x1875636141425920:12345-192.168.206.24@tcp:256: Request processed in 8871us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746158.743525:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:0.0:1788746158.753522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746158.753663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426048 00000100:00100000:3.0:1788746158.753674:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426048 00000100:00100000:3.0:1788746158.753729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:3.0:1788746158.753739:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5576:x1875636141426048:12345-192.168.206.24@tcp:101: 00010000:00010000:3.0:1788746158.753755:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746158.753771:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b10d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.753800:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.753829:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746158.753838:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746158.753890:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5576:x1875636141426048:12345-192.168.206.24@tcp:101: Request processed in 153us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746158.753898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:3.0:1788746158.756690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746158.756861:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426176 00000100:00100000:2.0:1788746158.756872:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426176 00000100:00100000:2.0:1788746158.756925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 122 00000100:00100000:2.0:1788746158.756936:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5576:x1875636141426176:12345-192.168.206.24@tcp:501: 00000100:00100000:2.0:1788746158.757201:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5576:x1875636141426176:12345-192.168.206.24@tcp:501: Request processed in 266us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746158.757209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 122 00000100:00100000:3.0:1788746158.761288:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746158.761660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426304 00000100:00100000:0.0:1788746158.761670:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426304 00000100:00100000:0.0:1788746158.761726:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 123 00000100:00100000:0.0:1788746158.761737:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5576:x1875636141426304:12345-192.168.206.24@tcp:503: 00000100:00100000:0.0:1788746158.762092:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5576:x1875636141426304:12345-192.168.206.24@tcp:503: Request processed in 356us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746158.762099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 123 00000100:00100000:0.0:1788746158.767624:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746158.767704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426432 00000100:00100000:2.0:1788746158.767714:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426432 00000100:00100000:2.0:1788746158.767766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 124 00000100:00100000:2.0:1788746158.767776:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5598:x1875636141426432:12345-192.168.206.24@tcp:502: 00000100:00100000:2.0:1788746158.768028:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5598:x1875636141426432:12345-192.168.206.24@tcp:502: Request processed in 253us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746158.768036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 124 00000100:00100000:0.0:1788746158.772016:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746158.772090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426560 00000100:00100000:3.0:1788746158.772100:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426560 00000100:00100000:3.0:1788746158.772151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 125 00000100:00100000:3.0:1788746158.772159:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5598:x1875636141426560:12345-192.168.206.24@tcp:502: 00000100:00100000:3.0:1788746158.772348:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5598:x1875636141426560:12345-192.168.206.24@tcp:502: Request processed in 188us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746158.772366:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 125 00000100:00100000:3.0:1788746158.777423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746158.777461:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426688 00000100:00100000:3.0:1788746158.777471:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426688 00000100:00100000:3.0:1788746158.777516:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746158.777524:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875636141426688:12345-192.168.206.24@tcp:38: 00010000:00080000:3.0:1788746158.777561:0:5849:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788746158.777607:0:5849:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b309907 00000004:00100000:3.0:1788746158.777633:0:5849:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788746158.777638:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788746158.803330:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9cd445674800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746158.804118:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141426688:12345-192.168.206.24@tcp:38: Request processed in 25977us (26103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746158.804129:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746159.547641:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163468544:0@lo:400: 00000100:00100000:3.0:1788746159.547739:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746159.547804:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746159.547811:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163468672:0@lo:400: 00000100:00100000:3.0:1788746159.547840:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746159.547873:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468544 00000100:00100000:3.0:1788746159.547880:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468544 00000100:00100000:3.0:1788746159.547932:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746159.547941:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163468544:12345-0@lo:400: 00000100:00100000:3.0:1788746159.547988:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163468544:12345-0@lo:400: Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746159.547994:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746159.548017:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468672 00000100:00100000:3.0:1788746159.548020:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468672 00000100:00100000:3.0:1788746159.548044:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746159.548063:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163468672:12345-0@lo:400: 00000100:00100000:3.0:1788746159.548095:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163468672:12345-0@lo:400: Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746159.548100:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788746159.548139:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0700 x1875636163468672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746159.548152:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163468672:0@lo:400: 00010000:00080000:3.0:1788746159.548162:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d3800 x1875636163468544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746159.548178:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163468544:0@lo:400: 00000100:00100000:0.0:1788746159.548395:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163468416:0@lo:400: 00000100:00100000:0.0:1788746159.548455:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746159.548474:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163468928:0@lo:400: 00000100:00100000:0.0:1788746159.548494:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746159.548519:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788746159.548536:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163468288:0@lo:400: 00000100:00100000:0.0:1788746159.548565:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746159.548586:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163468800:0@lo:400: 00000100:00100000:0.0:1788746159.548608:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788746159.548634:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746159.548638:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746159.548647:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468928 00000100:00100000:0.0:1788746159.548652:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468928 00000100:00100000:0.0:1788746159.548698:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788746159.548706:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163468928:12345-0@lo:400: 00000100:00100000:0.0:1788746159.548745:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163468928:12345-0@lo:400: Request processed in 40us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746159.548758:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788746159.548777:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468288 00000100:00100000:0.0:1788746159.548780:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468288 00000100:00100000:0.0:1788746159.548799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788746159.548805:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163468288:12345-0@lo:400: 00000100:00100000:0.0:1788746159.548836:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163468288:12345-0@lo:400: Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746159.548841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788746159.548861:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746159.548870:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468416 00000100:00100000:0.0:1788746159.548874:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468416 00000100:00100000:0.0:1788746159.548893:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163468800 00000100:00100000:0.0:1788746159.548896:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163468800 00000100:00100000:0.0:1788746159.548915:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788746159.548921:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163468416:12345-0@lo:400: 00000100:00100000:0.0:1788746159.548951:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163468416:12345-0@lo:400: Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746159.548957:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788746159.548967:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788746159.548973:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163468800:12345-0@lo:400: 00000100:00100000:0.0:1788746159.548996:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163468800:12345-0@lo:400: Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746159.549000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788746159.549016:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746159.549033:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163468288:0@lo:400: 00010000:00080000:0.0:1788746159.549044:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d1500 x1875636163468800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746159.549075:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163468800:0@lo:400: 00010000:00080000:0.0:1788746159.549088:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d2300 x1875636163468416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746159.549096:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163468416:0@lo:400: 00010000:00080000:0.0:1788746159.549104:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0e00 x1875636163468928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746159.549111:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788746159.549119:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163468928:0@lo:400: 00010000:00010000:0.0:1788746159.611269:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746159.808362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746159.808446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746159.808548:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426944 00000100:00100000:1.0:1788746159.808558:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426944 00000100:00100000:1.0:1788746159.808631:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141426816 00000100:00100000:1.0:1788746159.808634:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141426816 00000100:00100000:1.0:1788746159.808650:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:1.0:1788746159.808659:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:5576:x1875636141426944:12345-192.168.206.24@tcp:41: 00000004:00000024:1.0:1788746159.808699:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788746159.808755:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:5576:x1875636141426944:12345-192.168.206.24@tcp:41: Request processed in 97us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746159.808763:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:1.0:1788746159.808779:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:1.0:1788746159.808785:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:0:x1875636141426816:12345-192.168.206.24@tcp:41: 00000004:00000024:1.0:1788746159.808796:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788746159.808818:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:0:x1875636141426816:12345-192.168.206.24@tcp:41: Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746159.808824:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00080000:0.0:1788746159.808949:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746159.815516:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746159.817667:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427072 00000100:00100000:1.0:1788746159.817684:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427072 00000100:00100000:1.0:1788746159.817755:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:1.0:1788746159.817765:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5576:x1875636141427072:12345-192.168.206.24@tcp:40: 00000100:00100000:1.0:1788746159.817859:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5576:x1875636141427072:12345-192.168.206.24@tcp:40: Request processed in 95us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746159.817882:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:3.0:1788746159.822704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746159.822749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746159.822779:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746159.822817:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746159.823116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427456 00000100:00100000:1.0:1788746159.823126:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427456 00000100:00100000:1.0:1788746159.823184:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:1.0:1788746159.823195:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5576:x1875636141427456:12345-192.168.206.24@tcp:33: 00000100:00100000:2.0:1788746159.823282:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427200 00000100:00100000:2.0:1788746159.823287:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427200 00000100:00100000:2.0:1788746159.823323:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427328 00000100:00100000:2.0:1788746159.823327:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427328 00000100:00100000:2.0:1788746159.823353:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:2.0:1788746159.823359:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875636141427200:12345-192.168.206.24@tcp:8: 00010000:00080000:2.0:1788746159.823381:0:6680:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788746159.823440:0:6680:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b30990e 00002000:00100000:2.0:1788746159.823450:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 783b9179-e60a-4972-9e46-67c8ee44ca13/ffff9cd45f4f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788746159.823473:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788746159.823774:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788746159.823801:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746159.823857:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141427200:12345-192.168.206.24@tcp:8: Request processed in 497us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746159.823865:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:2.0:1788746159.823888:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:2.0:1788746159.823892:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875636141427328:12345-192.168.206.24@tcp:8: 00010000:00080000:2.0:1788746159.823908:0:6680:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788746159.823924:0:6680:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b309915 00002000:00100000:2.0:1788746159.823929:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 783b9179-e60a-4972-9e46-67c8ee44ca13/ffff9cd45f4f5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788746159.823943:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788746159.824141:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788746159.824157:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746159.824181:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141427328:12345-192.168.206.24@tcp:8: Request processed in 287us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746159.824188:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:0.0:1788746159.826086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427584 00000100:00100000:0.0:1788746159.826099:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427584 00000100:00100000:0.0:1788746159.826161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 127 00000100:00100000:0.0:1788746159.826171:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141427584:12345-192.168.206.24@tcp:400: 00000100:00100000:0.0:1788746159.826243:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141427584:12345-192.168.206.24@tcp:400: Request processed in 73us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746159.826250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 127 00000004:00080000:1.0:1788746159.856546:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33277us 00000004:00200000:1.0:1788746159.894187:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788746159.894298:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5576:x1875636141427456:12345-192.168.206.24@tcp:33: Request processed in 71100us (71598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746159.894309:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:3.0:1788746160.058852:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163469056:0@lo:13: 00000100:00100000:3.0:1788746160.058957:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746160.059132:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469056 00000100:00100000:2.0:1788746160.059144:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469056 00000100:00100000:2.0:1788746160.059220:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746160.059254:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163469056:12345-0@lo:13: 00002000:00000024:2.0:1788746160.059284:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746160.059346:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163469056:12345-0@lo:13: Request processed in 98us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746160.059354:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788746160.060338:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f4e1180 x1875636163469056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746160.060364:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163469056:0@lo:13: 00000100:00100000:2.0:1788746160.178836:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746160.178942:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427712 00000100:00100000:0.0:1788746160.178957:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427712 00000100:00100000:0.0:1788746160.179034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:0.0:1788746160.179056:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5616:x1875636141427712:12345-192.168.206.24@tcp:101: 00010000:00010000:0.0:1788746160.179093:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746160.179154:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030800/0xe59b64da5b30991c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b137 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179218:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179231:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179246:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746160.179279:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788746160.179283:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746160.179299:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179323:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030800/0xe59b64da5b30991c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b137 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179342:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b137 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746160.179350:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412500) 00010000:00010000:0.0:1788746160.179353:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746160.179356:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440030000, rc 0) 00000100:00100000:0.0:1788746160.179481:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:5616:x1875636141427712:12345-192.168.206.24@tcp:101: Request processed in 437us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746160.179488:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00010000:00010000:2.0:1788746160.634664:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746161.658630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746162.399429:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746162.405466:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427840 00000100:00100000:2.0:1788746162.405481:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427840 00000100:00100000:2.0:1788746162.405573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:2.0:1788746162.405585:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:5668:x1875636141427840:12345-192.168.206.24@tcp:41: 00000004:00000024:2.0:1788746162.405626:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1788746162.405754:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746162.405851:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:5668:x1875636141427840:12345-192.168.206.24@tcp:41: Request processed in 268us (6430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746162.405859:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:3.0:1788746162.411059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746162.411778:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141427968 00000100:00100000:0.0:1788746162.411789:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141427968 00000100:00100000:0.0:1788746162.411869:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:0.0:1788746162.411881:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5668:x1875636141427968:12345-192.168.206.24@tcp:13: 00002000:00000024:0.0:1788746162.411919:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746162.411984:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5668:x1875636141427968:12345-192.168.206.24@tcp:13: Request processed in 105us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746162.411993:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00080000:2.0:1788746162.412299:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746162.415933:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746162.416033:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428096 00000100:00100000:2.0:1788746162.416043:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428096 00000100:00100000:2.0:1788746162.416116:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:2.0:1788746162.416126:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5668:x1875636141428096:12345-192.168.206.24@tcp:13: 00002000:00000024:2.0:1788746162.416173:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746162.416237:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:783b9179-e60a-4972-9e46-67c8ee44ca13+6:5668:x1875636141428096:12345-192.168.206.24@tcp:13: Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746162.416245:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00080000:0.0:1788746162.416807:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746162.618971:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163469184:0@lo:13: 00000100:00100000:0.0:1788746162.619052:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746162.620112:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469184 00000100:00100000:1.0:1788746162.620123:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469184 00000100:00100000:1.0:1788746162.620206:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746162.620216:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163469184:12345-0@lo:13: 00002000:00000024:1.0:1788746162.620239:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788746162.620342:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746162.621908:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163469184:12345-0@lo:13: Request processed in 1689us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746162.621920:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788746162.622908:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08ce00 x1875636163469184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746162.622932:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163469184:0@lo:13: 00010000:00010000:2.0:1788746162.683481:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746163.714799:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788746164.211282:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000001:00100000:3.0:1788746164.225000:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000100:00100000:0.0:1788746164.666671:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746164.666746:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746164.666765:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163469440:0@lo:400: 00000100:00100000:1.0:1788746164.666830:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746164.666892:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469440 00000100:00100000:1.0:1788746164.666900:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469440 00000100:00100000:1.0:1788746164.666948:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788746164.666957:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163469440:12345-0@lo:400: 00000100:00100000:1.0:1788746164.667016:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163469440:12345-0@lo:400: Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746164.667024:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788746164.667063:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163469440:0@lo:400: 00000100:00100000:0.0:1788746164.672218:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163469312:0@lo:400: 00000100:00100000:0.0:1788746164.672542:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746164.672598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469312 00000100:00100000:0.0:1788746164.672605:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469312 00000100:00100000:0.0:1788746164.672654:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788746164.672663:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163469312:12345-0@lo:400: 00000100:00100000:0.0:1788746164.672708:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163469312:12345-0@lo:400: Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746164.672723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788746164.672770:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163469312:0@lo:400: 00000100:00100000:3.0:1788746164.676152:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163469568:0@lo:400: 00000100:00100000:3.0:1788746164.676216:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746164.676560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469568 00000100:00100000:3.0:1788746164.676568:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469568 00000100:00100000:3.0:1788746164.676773:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746164.676782:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163469568:12345-0@lo:400: 00000100:00080000:0.0:1788746164.680927:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746164.682395:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163469568:12345-0@lo:400: Request processed in 5604us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746164.682421:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746164.682504:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163469568:0@lo:400: 00000100:00100000:3.0:1788746164.682580:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163469696:0@lo:400: 00000100:00100000:3.0:1788746164.682650:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746164.682691:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469696 00000100:00100000:3.0:1788746164.682697:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469696 00000100:00100000:3.0:1788746164.682744:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746164.682752:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163469696:12345-0@lo:400: 00000100:00100000:3.0:1788746164.682793:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163469696:12345-0@lo:400: Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746164.682799:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788746164.682825:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001ce00 x1875636163469696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746164.682836:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163469696:0@lo:400: 00000100:00080000:3.0:1788746164.682850:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746164.682875:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163469824:0@lo:400: 00000100:00100000:3.0:1788746164.682897:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746164.682921:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469824 00000100:00100000:3.0:1788746164.682924:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469824 00000100:00100000:3.0:1788746164.682948:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746164.682954:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163469824:12345-0@lo:400: 00000100:00100000:3.0:1788746164.682981:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163469824:12345-0@lo:400: Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746164.682987:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746164.683008:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163469824:0@lo:400: 00000100:00080000:3.0:1788746164.683019:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746164.683043:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163469952:0@lo:400: 00000100:00100000:3.0:1788746164.683066:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746164.683092:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163469952 00000100:00100000:3.0:1788746164.683101:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163469952 00000100:00100000:3.0:1788746164.683128:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746164.683134:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163469952:12345-0@lo:400: 00000100:00100000:3.0:1788746164.683166:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163469952:12345-0@lo:400: Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746164.683171:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788746164.683184:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788746164.683200:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001ce00 x1875636163469952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746164.683210:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163469952:0@lo:400: 00010000:00010000:1.0:1788746164.735372:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788746164.767719:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000100:00100000:3.0:1788746165.178772:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163470080:0@lo:13: 00000100:00100000:3.0:1788746165.178848:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746165.179016:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470080 00000100:00100000:0.0:1788746165.179025:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470080 00000100:00100000:0.0:1788746165.179082:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746165.179091:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163470080:12345-0@lo:13: 00002000:00000024:0.0:1788746165.179127:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746165.179182:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163470080:12345-0@lo:13: Request processed in 92us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746165.179188:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788746165.179285:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb53800 x1875636163470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746165.179304:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163470080:0@lo:13: 00000100:00100000:1.0:1788746165.273373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746165.279215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746165.279260:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746165.279299:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746165.279335:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428352 00000100:00100000:1.0:1788746165.279344:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428352 00000100:00100000:1.0:1788746165.279430:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:1.0:1788746165.279440:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141428352:12345-192.168.206.24@tcp:400: 00000100:00100000:1.0:1788746165.279529:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141428352:12345-192.168.206.24@tcp:400: Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746165.279537:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:1.0:1788746165.279560:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428480 00000100:00100000:1.0:1788746165.279565:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428480 00000100:00100000:1.0:1788746165.279591:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428608 00000100:00100000:1.0:1788746165.279594:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428608 00000100:00100000:1.0:1788746165.279624:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:1.0:1788746165.279631:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141428480:12345-192.168.206.24@tcp:400: 00000100:00100000:1.0:1788746165.279656:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141428480:12345-192.168.206.24@tcp:400: Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746165.279662:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:1.0:1788746165.279675:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746165.279692:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141428608:12345-192.168.206.24@tcp:400: 00000100:00100000:1.0:1788746165.279717:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141428608:12345-192.168.206.24@tcp:400: Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746165.279723:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00080000:1.0:1788746165.279755:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746165.279759:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746165.279762:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746165.283958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428224 00000100:00100000:2.0:1788746165.283988:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428224 00000100:00100000:2.0:1788746165.285623:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 129 00000100:00100000:2.0:1788746165.285643:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141428224:12345-192.168.206.24@tcp:400: 00000100:00100000:2.0:1788746165.285725:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141428224:12345-192.168.206.24@tcp:400: Request processed in 91us (12361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746165.285732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 129 00000001:02000400:2.0:1788746165.479927:0:8288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788746165.755043:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746166.778908:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746167.740016:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163470208:0@lo:13: 00000100:00100000:3.0:1788746167.740099:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746167.740277:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470208 00000100:00100000:2.0:1788746167.740286:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470208 00000100:00100000:2.0:1788746167.740352:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746167.740362:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163470208:12345-0@lo:13: 00002000:00000024:2.0:1788746167.740417:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746167.740463:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163470208:12345-0@lo:13: Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746167.740470:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788746167.740531:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08f800 x1875636163470208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746167.740551:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163470208:0@lo:13: 00000100:00080000:3.0:1788746167.740681:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746167.814365:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746168.828273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788746169.064940:0:8435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea3bb4bf0 20000000:00000080:3.0:1788746169.064959:0:8435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd4800dd400 uarg=0000000000000000 20000000:01000000:3.0:1788746169.065009:0:8435:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788746169.065011:0:8435:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788746169.065014:0:8435:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788746169.065019:0:8435:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788746169.065023:0:8435:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788746169.065042:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788746169.065044:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788746169.065225:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788746169.065227:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788746169.082814:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788746169.083320:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788746169.083385:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788746169.083486:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788746169.083502:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788746169.083506:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788746169.084080:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788746169.084463:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788746169.084522:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788746169.084562:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788746169.084577:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788746169.084579:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788746169.087273:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788746169.087793:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788746169.087860:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788746169.087917:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788746169.087932:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788746169.087934:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788746169.089228:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788746169.089820:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788746169.090582:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788746169.090665:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1788746169.090686:0:8435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788746169.090705:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090723:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309820 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090730:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30984a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090736:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309874 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090758:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309882 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090765:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309890 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090772:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090778:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090788:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090795:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090802:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090843:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.090858:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 9 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.091638:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470336:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746169.091749:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.091768:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.091777:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470464:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746169.091816:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.091823:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 18 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.091831:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470592:0@lo:104: 00000100:00100000:1.0:1788746169.091877:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746169.091917:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.091925:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 18 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.091933:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470720:0@lo:104: 00000100:00100000:1.0:1788746169.091957:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746169.091986:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.091993:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 18 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.092001:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470848:0@lo:104: 00010000:00010000:1.0:1788746169.092021:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.092034:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 18 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.092042:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470976:0@lo:104: 00010000:00010000:1.0:1788746169.092065:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.092072:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 18 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.092079:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471104:0@lo:104: 00010000:00010000:1.0:1788746169.092103:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.092110:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 18 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.092118:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471232:0@lo:104: 00010000:00010000:1.0:1788746169.092140:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.092148:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 18 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.092154:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471360:0@lo:104: 00000100:00100000:1.0:1788746169.092171:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477679cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746169.092990:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788746169.093015:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.093042:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.093051:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.093071:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.093082:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.093089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470592 00000100:00100000:1.0:1788746169.093096:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470592 00000100:00100000:1.0:1788746169.093131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470720 00000100:00100000:1.0:1788746169.093133:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470720 00000100:00100000:1.0:1788746169.093141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470848 00000100:00100000:1.0:1788746169.093143:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470848 00000100:00100000:1.0:1788746169.093150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163470976 00000100:00100000:1.0:1788746169.093152:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163470976 00000100:00100000:1.0:1788746169.093161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471104 00000100:00100000:1.0:1788746169.093163:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471104 00000100:00100000:1.0:1788746169.093170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471232 00000100:00100000:1.0:1788746169.093171:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471232 00000100:00100000:1.0:1788746169.093179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471360 00000100:00100000:1.0:1788746169.093181:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471360 00000100:00100000:1.0:1788746169.093194:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746169.093202:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:8435:x1875636163470592:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093216:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093269:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746169.093274:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+9:8435:x1875636163470592:12345-0@lo:104: Request processed in 74us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746169.093297:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746169.093303:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477405450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+8:8435:x1875636163470720:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093310:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093352:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788746169.093357:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477405450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+8:8435:x1875636163470720:12345-0@lo:104: Request processed in 55us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093363:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746169.093391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746169.093414:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+7:8435:x1875636163470848:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093422:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093448:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788746169.093453:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+7:8435:x1875636163470848:12345-0@lo:104: Request processed in 56us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746169.093481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746169.093487:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+6:8435:x1875636163470976:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093493:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093517:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788746169.093521:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+6:8435:x1875636163470976:12345-0@lo:104: Request processed in 36us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093526:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746169.093536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746169.093541:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:8435:x1875636163471104:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093547:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093575:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788746169.093580:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:8435:x1875636163471104:12345-0@lo:104: Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746169.093597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746169.093602:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:8435:x1875636163471232:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093609:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093630:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788746169.093634:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:8435:x1875636163471232:12345-0@lo:104: Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746169.093649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746169.093654:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:8435:x1875636163471360:12345-0@lo:104: 00010000:00010000:1.0:1788746169.093660:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093680:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788746169.093685:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:8435:x1875636163471360:12345-0@lo:104: Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.093690:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788746169.093705:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788746169.093710:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093717:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746169.093726:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093735:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746169.093742:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746169.093748:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788746169.093774:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093781:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746169.093794:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45600/0xe59b64da5b3098d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093814:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788746169.093817:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093822:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746169.093825:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.093831:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746169.093846:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746169.093851:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788746169.095197:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163471488:0@lo:103: 00000100:00100000:3.0:1788746169.095246:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.095311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471488 00000100:00100000:3.0:1788746169.095318:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471488 00010000:00010000:3.0:1788746169.095346:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 19 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.095370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746169.095377:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163471488:12345-0@lo:103: 00010000:00010000:3.0:1788746169.095388:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.095393:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 19 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095423:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 19 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095441:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.095487:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163471488:12345-0@lo:103: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.095493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746169.095539:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163471488:0@lo:103: 00010000:00010000:3.0:1788746169.095569:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788746169.095726:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788746169.095734:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095750:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09a600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746169.095754:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095762:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746169.095770:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746169.095776:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746169.095799:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095805:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746169.095818:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095825:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a600/0xe59b64da5b309890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309897 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095836:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788746169.095839:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095845:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746169.095848:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095876:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746169.095882:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746169.095887:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746169.095902:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095908:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746169.095922:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095928:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f44000/0xe59b64da5b309874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30987b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095940:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746169.095943:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095948:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746169.095950:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095957:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746169.095962:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746169.095973:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746169.095989:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.095995:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746169.096001:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096006:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30984a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309851 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096015:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746169.096018:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096024:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44800 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746169.096027:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096034:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746169.096041:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746169.096046:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746169.096056:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096062:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746169.096072:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096079:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f44800/0xe59b64da5b309820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309827 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096088:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.096090:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.096093:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746169.096102:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163471744:0@lo:103: 00000100:00100000:3.0:1788746169.096131:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.096151:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746169.096157:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163472128:0@lo:103: 00000100:00100000:3.0:1788746169.096176:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.096199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471744 00000100:00100000:3.0:1788746169.096203:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471744 00010000:00010000:3.0:1788746169.096219:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.096300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472128 00000100:00100000:3.0:1788746169.096304:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472128 00010000:00010000:3.0:1788746169.096317:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 20 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.096328:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746169.096333:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3317:x1875636163471744:12345-0@lo:103: 00010000:00010000:3.0:1788746169.096342:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.096345:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 20 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096363:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 20 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096374:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.096423:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3317:x1875636163471744:12345-0@lo:103: Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.096429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746169.096443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788746169.096449:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163472128:12345-0@lo:103: 00010000:00010000:3.0:1788746169.096457:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.096461:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 19 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096480:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 19 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096490:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.096512:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163472128:12345-0@lo:103: Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.096518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788746169.096543:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163472128:0@lo:103: 00000100:00100000:3.0:1788746169.096550:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163471744:0@lo:103: 00000100:00100000:3.0:1788746169.096655:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163472000:0@lo:103: 00000100:00100000:3.0:1788746169.096681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.096698:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746169.096703:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163471872:0@lo:103: 00000100:00100000:3.0:1788746169.096731:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.096749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472000 00000100:00100000:3.0:1788746169.096753:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472000 00010000:00010000:3.0:1788746169.096766:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 19 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.096777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471872 00000100:00100000:3.0:1788746169.096780:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471872 00010000:00010000:3.0:1788746169.096789:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 20 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.096800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746169.096806:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3315:x1875636163472000:12345-0@lo:103: 00010000:00010000:3.0:1788746169.096813:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.096816:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 20 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096824:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 20 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096834:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.096864:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3315:x1875636163472000:12345-0@lo:103: Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.096869:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746169.096881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746169.096886:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163471872:12345-0@lo:103: 00010000:00010000:3.0:1788746169.096893:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.096897:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096914:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.096924:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.096946:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163471872:12345-0@lo:103: Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.096952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746169.096975:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163471872:0@lo:103: 00000100:00100000:3.0:1788746169.096983:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163472000:0@lo:103: 00010000:00010000:3.0:1788746169.097128:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.097134:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097141:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746169.097144:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097151:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746169.097156:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746169.097161:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746169.097180:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097186:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746169.097205:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097211:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f44c00/0xe59b64da5b309882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.097229:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163472256:0@lo:103: 00000100:00100000:3.0:1788746169.097255:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.097280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472256 00000100:00100000:3.0:1788746169.097283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472256 00010000:00010000:3.0:1788746169.097296:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.097309:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746169.097314:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163472256:12345-0@lo:103: 00010000:00010000:3.0:1788746169.097321:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746169.097324:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097331:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 19 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746169.097340:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746169.097365:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163472256:12345-0@lo:103: Request processed in 51us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.097370:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746169.097392:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163472256:0@lo:103: 00010000:00010000:3.0:1788746169.097425:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.097427:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.097434:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.097437:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746169.097439:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746169.097585:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440031800/0xe59b64da5b3098dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3098d6 expref: 18 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097597:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470592:0@lo:104: 00000100:00100000:0.0:1788746169.097608:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470720:0@lo:104: 00010000:00010000:0.0:1788746169.097628:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440031e00/0xe59b64da5b309897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309890 expref: 17 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097636:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470848:0@lo:104: 00010000:00010000:0.0:1788746169.097644:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440031c00/0xe59b64da5b309889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309882 expref: 16 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097651:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470976:0@lo:104: 00010000:00010000:0.0:1788746169.097660:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30987b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309874 expref: 15 pid: 5844 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097668:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471104:0@lo:104: 00010000:00010000:0.0:1788746169.097676:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479200/0xe59b64da5b309851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30984a expref: 14 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097684:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471232:0@lo:104: 00010000:00010000:0.0:1788746169.097692:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b309827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309820 expref: 13 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746169.097699:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163471360:0@lo:104: 00010000:00010000:1.0:1788746169.097906:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.097914:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746169.097943:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.097950:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b3098ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3098b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.097964:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746169.097966:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746169.097968:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746169.098709:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746169.098727:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163471616:0@lo:103: 00000100:00100000:0.0:1788746169.098778:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.099007:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163471616 00000100:00100000:1.0:1788746169.099015:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163471616 00010000:00010000:1.0:1788746169.099045:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 13 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.099080:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746169.099089:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:3315:x1875636163471616:12345-0@lo:103: 00010000:00010000:1.0:1788746169.099099:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746169.099104:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 13 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.099113:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 13 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.099139:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441478c00/0xe59b64da5b3098b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3098ac expref: 13 pid: 5842 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.099151:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746169.099185:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3315:x1875636163471616:12345-0@lo:103: Request processed in 98us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.099192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746169.099242:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163471616:0@lo:103: 00000100:00100000:2.0:1788746169.101151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746169.101187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746169.101312:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470336:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746169.101323:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875636163470464:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746169.101365:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.101729:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428736 00000100:00100000:1.0:1788746169.101737:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428736 00010000:00010000:1.0:1788746169.101767:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 10 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.101796:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428864 00000100:00100000:1.0:1788746169.101800:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428864 00010000:00010000:1.0:1788746169.101812:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 11 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746169.101826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746169.101833:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2349:x1875636141428736:12345-192.168.206.24@tcp:103: 00010000:00010000:1.0:1788746169.101846:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746169.101851:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 11 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.101862:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 11 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.101939:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440031a00/0xe59b64da5b3098f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0dc expref: 11 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.101960:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746169.102066:0:5836:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788746169.102075:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788746169.102182:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141428736:12345-192.168.206.24@tcp:103: Request processed in 347us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.102190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746169.102208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:1.0:1788746169.102215:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+9:2349:x1875636141428864:12345-192.168.206.24@tcp:103: 00010000:00010000:1.0:1788746169.102224:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746169.102228:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102237:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102248:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440030e00/0xe59b64da5b3098eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b0d5 expref: 9 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102259:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102266:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102289:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102296:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102303:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102316:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102322:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746169.102326:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102334:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102354:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746169.102365:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746169.102388:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+8:2349:x1875636141428864:12345-192.168.206.24@tcp:103: Request processed in 174us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.102395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00010000:00010000:0.0:1788746169.102716:0:8435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.102724:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.102729:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479400/0xe59b64da5b30992a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746169.415673:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746169.415794:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141428992 00000100:00100000:0.0:1788746169.415806:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141428992 00000100:00100000:0.0:1788746169.415867:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 130 00000100:00100000:0.0:1788746169.415878:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+8:5590:x1875636141428992:12345-192.168.206.24@tcp:101: 00010000:00010000:0.0:1788746169.415893:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746169.415913:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd482042000/0xe59b64da5b309931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b13e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.415942:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd482042000/0xe59b64da5b309931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b13e expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.415953:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd482042000/0xe59b64da5b309931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b13e expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.415962:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd482042000, rc 0) 00000100:00100000:0.0:1788746169.416021:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141428992:12345-192.168.206.24@tcp:101: Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746169.416043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 130 00000100:00100000:2.0:1788746169.424074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746169.424185:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429120 00000100:00100000:1.0:1788746169.424195:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429120 00000100:00100000:1.0:1788746169.424254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 131 00000100:00100000:1.0:1788746169.424264:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141429120:12345-192.168.206.24@tcp:501: 00000100:00100000:1.0:1788746169.424650:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141429120:12345-192.168.206.24@tcp:501: Request processed in 386us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.424657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 131 00000100:00100000:2.0:1788746169.426929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746169.427012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429248 00000100:00100000:3.0:1788746169.427021:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429248 00000100:00100000:3.0:1788746169.427072:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 132 00000100:00100000:3.0:1788746169.427081:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141429248:12345-192.168.206.24@tcp:503: 00000100:00100000:3.0:1788746169.427286:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141429248:12345-192.168.206.24@tcp:503: Request processed in 205us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.427294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 132 00000100:00100000:3.0:1788746169.430217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746169.430299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429376 00000100:00100000:0.0:1788746169.430308:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429376 00000100:00100000:0.0:1788746169.430358:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 133 00000100:00100000:0.0:1788746169.430369:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:6056:x1875636141429376:12345-192.168.206.24@tcp:502: 00000100:00100000:0.0:1788746169.430989:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:6056:x1875636141429376:12345-192.168.206.24@tcp:502: Request processed in 621us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746169.430998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 133 00000100:00100000:2.0:1788746169.441632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746169.442388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429504 00000100:00100000:1.0:1788746169.442434:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429504 00000100:00100000:1.0:1788746169.442502:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 134 00000100:00100000:1.0:1788746169.442511:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:6056:x1875636141429504:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746169.442771:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:6056:x1875636141429504:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 260us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.442778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 134 00000100:00100000:2.0:1788746169.448693:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746169.450474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429632 00000100:00100000:0.0:1788746169.450488:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429632 00000100:00100000:0.0:1788746169.450547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 135 00000100:00100000:0.0:1788746169.450557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141429632:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746169.450574:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746169.450593:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd482043800/0xe59b64da5b309938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b145 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.450622:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd482043800/0xe59b64da5b309938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b145 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.450633:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd482043800/0xe59b64da5b309938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b145 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746169.450641:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd482043800, rc 0) 00000100:00100000:0.0:1788746169.450706:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141429632:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 150us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746169.450713:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 135 00000100:00100000:3.0:1788746169.455748:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746169.455898:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429760 00000100:00100000:1.0:1788746169.455908:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429760 00000100:00100000:1.0:1788746169.455962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 136 00000100:00100000:1.0:1788746169.455972:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141429760:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746169.456242:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141429760:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 271us (501us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788746169.456251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 136 00000100:00100000:2.0:1788746169.786893:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163472640:0@lo:400: 00000100:00100000:1.0:1788746169.786902:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163472512:0@lo:400: 00000100:00100000:3.0:1788746169.786984:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163472768:0@lo:400: 00000100:00100000:0.0:1788746169.787004:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163472384:0@lo:400: 00000100:00100000:1.0:1788746169.791756:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.791843:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163473024:0@lo:400: 00000100:00100000:1.0:1788746169.791885:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.791941:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472512 00000100:00100000:1.0:1788746169.791949:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472512 00000100:00100000:1.0:1788746169.793511:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788746169.793526:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163472512:12345-0@lo:400: 00000100:00100000:1.0:1788746169.793673:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163472512:12345-0@lo:400: Request processed in 151us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.793680:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788746169.793710:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473024 00000100:00100000:1.0:1788746169.793717:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473024 00000100:00100000:1.0:1788746169.793755:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746169.793761:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163473024:12345-0@lo:400: 00000100:00100000:1.0:1788746169.793806:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163473024:12345-0@lo:400: Request processed in 45us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.793813:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788746169.793832:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746169.793866:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163472512:0@lo:400: 00010000:00080000:1.0:1788746169.793879:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f600700 x1875636163473024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746169.793888:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163473024:0@lo:400: 00000100:00100000:3.0:1788746169.798847:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.799158:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472768 00000100:00100000:1.0:1788746169.799168:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472768 00000100:00100000:1.0:1788746169.799229:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746169.799238:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163472768:12345-0@lo:400: 00000100:00100000:1.0:1788746169.799300:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163472768:12345-0@lo:400: Request processed in 63us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.799307:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788746169.799325:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746169.799496:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f600e00 x1875636163472768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746169.799511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163472768:0@lo:400: 00000100:00100000:2.0:1788746169.801167:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746169.804888:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472640 00000100:00100000:1.0:1788746169.804906:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472640 00000100:00100000:1.0:1788746169.805051:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746169.805064:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163472640:12345-0@lo:400: 00000100:00100000:1.0:1788746169.805171:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163472640:12345-0@lo:400: Request processed in 111us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.805179:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788746169.805754:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163472640:0@lo:400: 00000100:00100000:0.0:1788746169.806065:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746169.806111:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163472896:0@lo:400: 00000100:00100000:0.0:1788746169.806142:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746169.806243:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472384 00000100:00100000:3.0:1788746169.806249:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472384 00000100:00100000:3.0:1788746169.806289:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788746169.806296:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3315:x1875636163472384:12345-0@lo:400: 00000100:00100000:3.0:1788746169.806346:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:3315:x1875636163472384:12345-0@lo:400: Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746169.806352:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788746169.806366:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163472384:0@lo:400: 00000100:00100000:1.0:1788746169.806673:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163472896 00000100:00100000:1.0:1788746169.806679:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163472896 00000100:00080000:2.0:1788746169.807715:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746169.812027:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746169.812042:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163472896:12345-0@lo:400: 00000100:00100000:1.0:1788746169.812145:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163472896:12345-0@lo:400: Request processed in 106us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746169.812152:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746169.812283:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163472896:0@lo:400: 00010000:00010000:3.0:1788746169.850824:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746170.303735:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746170.303760:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163473152:0@lo:13: 00000100:00100000:1.0:1788746170.303830:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746170.304443:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473152 00000100:00100000:2.0:1788746170.304451:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473152 00000100:00100000:2.0:1788746170.304523:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788746170.304532:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163473152:12345-0@lo:13: 00002000:00000024:2.0:1788746170.304565:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746170.304622:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163473152:12345-0@lo:13: Request processed in 91us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746170.304629:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788746170.304839:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb52a00 x1875636163473152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746170.304862:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163473152:0@lo:13: 00000100:00100000:2.0:1788746170.391258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746170.391304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746170.391334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430016 00000100:00100000:3.0:1788746170.391345:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430016 00000100:00100000:2.0:1788746170.391349:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746170.391380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00080000:2.0:1788746170.391429:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746170.391446:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430272 00000100:00100000:2.0:1788746170.391450:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430272 00000100:00100000:2.0:1788746170.391496:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430144 00000100:00100000:2.0:1788746170.391500:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430144 00000100:00100000:2.0:1788746170.391519:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:2.0:1788746170.391534:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141430272:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746170.391536:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:3.0:1788746170.391552:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141430016:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746170.391628:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788746170.391631:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141430272:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746170.391639:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788746170.391643:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:2.0:1788746170.391671:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:2.0:1788746170.391688:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141430144:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746170.392041:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141430016:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 491us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746170.392048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141429888 00000100:00100000:3.0:1788746170.392049:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:1.0:1788746170.392056:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141429888 00000100:00100000:1.0:1788746170.392091:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 138 00000100:00100000:1.0:1788746170.392099:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2348:x1875636141429888:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746170.392140:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2348:x1875636141429888:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 41us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746170.392148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 138 00000100:00080000:3.0:1788746170.392157:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746170.392162:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746170.399939:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141430144:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 8249us (8545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746170.399966:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00010000:00010000:2.0:1788746170.880754:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788746171.067571:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788746171.067578:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd47ebce000 from 39 10000000:01000000:0.0:1788746171.067583:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746171.067623:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.067634:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.067645:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.067664:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473280:0@lo:101: 00000100:00100000:0.0:1788746171.067723:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.067774:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.067832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473280 00000100:00100000:1.0:1788746171.067840:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473280 00000100:00100000:1.0:1788746171.067896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788746171.067906:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+12:5846:x1875636163473280:12345-0@lo:101: 00010000:00010000:1.0:1788746171.067918:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746171.067929:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479600/0xe59b64da5b309946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30993f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.067950:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479600/0xe59b64da5b309946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30993f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.067974:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479600/0xe59b64da5b309946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30993f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.067982:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479600, rc 0) 00000100:00100000:1.0:1788746171.068025:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473280:12345-0@lo:101: Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.068031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788746171.068123:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473280:0@lo:101: 00010000:00010000:2.0:1788746171.068136:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.068143:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.068197:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473408:0@lo:501: 00000100:00100000:2.0:1788746171.068223:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746171.068250:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4463136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.068296:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473408 00000100:00100000:1.0:1788746171.068301:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473408 00000100:00100000:1.0:1788746171.068332:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788746171.068339:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473408:12345-0@lo:501: 00000100:00100000:1.0:1788746171.068619:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473408:12345-0@lo:501: Request processed in 279us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.068626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788746171.068652:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473408:0@lo:501: 00000100:00100000:1.0:1788746171.068680:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473536:0@lo:503: 00000100:00100000:1.0:1788746171.068714:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.068725:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c27000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.068736:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473536 00000100:00100000:1.0:1788746171.068739:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473536 00000100:00100000:1.0:1788746171.068755:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788746171.068760:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473536:12345-0@lo:503: 00000100:00100000:1.0:1788746171.068893:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473536:12345-0@lo:503: Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.068899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788746171.068943:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473536:0@lo:503: 00000100:00100000:1.0:1788746171.071626:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8477:1875636163473664:0@lo:502: 00000100:00100000:1.0:1788746171.071696:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.071771:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345397000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.072232:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473664 00000100:00100000:0.0:1788746171.072241:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473664 00000100:00100000:0.0:1788746171.072297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788746171.072306:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:8477:x1875636163473664:12345-0@lo:502: 00000100:00100000:0.0:1788746171.072595:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:8477:x1875636163473664:12345-0@lo:502: Request processed in 288us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.072610:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788746171.073089:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8477:1875636163473664:0@lo:502: 00000100:00100000:1.0:1788746171.073152:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8477:1875636163473792:0@lo:502: 00000100:00100000:1.0:1788746171.073195:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.073224:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c27000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.073846:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473792 00000100:00100000:0.0:1788746171.073853:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473792 00000100:00100000:0.0:1788746171.073900:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788746171.073909:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:8477:x1875636163473792:12345-0@lo:502: 00000100:00100000:0.0:1788746171.074128:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+13:8477:x1875636163473792:12345-0@lo:502: Request processed in 219us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.074135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788746171.076578:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8477:1875636163473792:0@lo:502: 00000040:00080000:1.0:1788746171.076629:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788746171.077660:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788746171.077698:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788746171.077709:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.077720:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746171.077728:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788746171.077730:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788746171.077733:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788746171.077766:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.077774:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.077783:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.077803:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473920:0@lo:101: 00000100:00100000:0.0:1788746171.077866:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.078257:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.078434:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163473920 00000100:00100000:1.0:1788746171.078442:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163473920 00000100:00100000:1.0:1788746171.078501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788746171.078511:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+13:5846:x1875636163473920:12345-0@lo:101: 00010000:00010000:1.0:1788746171.078524:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746171.078536:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478c00/0xe59b64da5b309954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30994d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.078561:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478c00/0xe59b64da5b309954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30994d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.078571:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478c00/0xe59b64da5b309954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30994d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.078579:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478c00, rc 0) 00000100:00100000:1.0:1788746171.078621:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163473920:12345-0@lo:101: Request processed in 112us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.078640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788746171.078776:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163473920:0@lo:101: 00010000:00010000:0.0:1788746171.078792:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.078801:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.078857:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474048:0@lo:501: 00000100:00100000:0.0:1788746171.078886:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.078917:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.079059:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474048 00000100:00100000:1.0:1788746171.079064:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474048 00000100:00100000:1.0:1788746171.079096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788746171.079102:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163474048:12345-0@lo:501: 00000100:00100000:1.0:1788746171.079334:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163474048:12345-0@lo:501: Request processed in 231us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.079342:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788746171.079541:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474048:0@lo:501: 00000100:00100000:0.0:1788746171.079573:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474176:0@lo:503: 00000100:00100000:0.0:1788746171.079613:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.079634:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.079645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474176 00000100:00100000:0.0:1788746171.079649:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474176 00000100:00100000:0.0:1788746171.079672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788746171.079678:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163474176:12345-0@lo:503: 00000100:00100000:0.0:1788746171.079815:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163474176:12345-0@lo:503: Request processed in 136us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.079822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788746171.079861:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474176:0@lo:503: 00000100:00100000:0.0:1788746171.080059:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8479:1875636163474304:0@lo:502: 00000100:00100000:0.0:1788746171.080107:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.080120:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746171.080390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474304 00000100:00100000:2.0:1788746171.080395:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474304 00000100:00100000:2.0:1788746171.080446:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788746171.080453:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8479:x1875636163474304:12345-0@lo:502: 00000100:00100000:2.0:1788746171.080611:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8479:x1875636163474304:12345-0@lo:502: Request processed in 158us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746171.080618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788746171.081617:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8479:1875636163474304:0@lo:502: 00000020:01000000:0.0:1788746171.081649:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746171.081658:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746171.081660:0:8479:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788746171.081665:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788746171.081695:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8479:1875636163474432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.081744:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.081779:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.081830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474432 00000100:00100000:1.0:1788746171.081836:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474432 00000100:00100000:1.0:1788746171.081875:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788746171.081884:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8479:x1875636163474432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746171.082056:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:8479:x1875636163474432:12345-0@lo:502:llog_process_th.0 Request processed in 173us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.082063:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788746171.082144:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8479:1875636163474432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746171.082161:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746171.082165:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746171.082167:0:8479:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788746171.082171:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788746171.082303:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788746171.082323:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788746171.082331:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.082342:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746171.082351:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788746171.082354:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448dea800 from 39 10000000:01000000:1.0:1788746171.082357:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788746171.082379:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.082392:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.082802:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746171.082820:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.082856:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.082876:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345397000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.082945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474560 00000100:00100000:0.0:1788746171.082950:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474560 00000100:00100000:0.0:1788746171.082983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788746171.082990:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+14:5846:x1875636163474560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.083000:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746171.083012:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd482042600/0xe59b64da5b309962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30995b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.083032:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd482042600/0xe59b64da5b309962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30995b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.083041:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd482042600/0xe59b64da5b309962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30995b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.083060:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd482042600, rc 0) 00000100:00100000:0.0:1788746171.083094:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163474560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.083101:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788746171.083131:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.083143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.083151:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.083194:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.083220:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.083241:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.083252:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474688 00000100:00100000:0.0:1788746171.083255:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474688 00000100:00100000:0.0:1788746171.083276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788746171.083283:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163474688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.084975:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163474688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1688us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.084986:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788746171.085107:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.085151:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.085192:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.085227:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345397000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.085270:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474816 00000100:00100000:0.0:1788746171.085366:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474816 00000100:00100000:0.0:1788746171.086477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788746171.086489:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163474816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.086681:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163474816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.086689:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788746171.091957:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163474816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746171.092555:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8481:1875636163474944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746171.092628:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746171.092671:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.095167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163474944 00000100:00100000:0.0:1788746171.095180:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163474944 00000100:00100000:0.0:1788746171.095232:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788746171.095243:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8481:x1875636163474944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.095772:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8481:x1875636163474944:12345-0@lo:502:llog_process_th.0 Request processed in 530us (3142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.095782:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788746171.095794:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8481:1875636163474944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746171.095875:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8481:1875636163475072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746171.095919:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.096140:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475072 00000100:00100000:0.0:1788746171.096146:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475072 00000100:00100000:0.0:1788746171.096178:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788746171.096186:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8481:x1875636163475072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746171.096309:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.096584:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+15:8481:x1875636163475072:12345-0@lo:502:llog_process_th.0 Request processed in 397us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.096594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788746171.096718:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8481:1875636163475072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788746171.096742:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788746171.097085:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788746171.097106:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788746171.097115:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.097126:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746171.097134:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788746171.097137:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788746171.097140:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788746171.097164:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.097178:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.097187:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746171.097205:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.097238:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.097443:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.102304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475200 00000100:00100000:0.0:1788746171.102318:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475200 00000100:00100000:0.0:1788746171.103094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788746171.103108:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+15:5846:x1875636163475200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.103125:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746171.103143:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd482042400/0xe59b64da5b309970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309969 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.103171:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd482042400/0xe59b64da5b309970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309969 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.103190:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd482042400/0xe59b64da5b309970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309969 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.103198:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd482042400, rc 0) 00000100:00100000:0.0:1788746171.103293:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (6054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.103300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788746171.103560:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746171.103579:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.103588:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.103655:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.103689:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.105836:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.107258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475328 00000100:00100000:1.0:1788746171.107269:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475328 00000100:00100000:1.0:1788746171.107482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788746171.107491:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.107782:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.107789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788746171.107854:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.107901:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.107944:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.107969:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746171.107980:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475456 00000100:00100000:1.0:1788746171.107984:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475456 00000100:00100000:1.0:1788746171.108000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788746171.108006:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.108134:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.108147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788746171.108184:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.108360:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8483:1875636163475584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746171.108421:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.108433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475584 00000100:00100000:0.0:1788746171.108440:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475584 00000100:00100000:1.0:1788746171.108445:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44746d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.108482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788746171.108492:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8483:x1875636163475584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.108844:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8483:x1875636163475584:12345-0@lo:502:llog_process_th.0 Request processed in 353us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.108853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788746171.109058:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8483:1875636163475584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746171.109086:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746171.109094:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746171.109102:0:8483:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788746171.109107:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788746171.109130:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8483:1875636163475712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746171.109295:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746171.109330:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746171.109531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475712 00000100:00100000:3.0:1788746171.109537:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475712 00000100:00100000:3.0:1788746171.109569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788746171.109576:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8483:x1875636163475712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746171.109739:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:8483:x1875636163475712:12345-0@lo:502:llog_process_th.0 Request processed in 162us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.109747:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788746171.109825:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8483:1875636163475712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746171.110540:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746171.110549:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746171.110551:0:8483:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788746171.110555:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788746171.110714:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788746171.110745:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788746171.110754:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.110766:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746171.110775:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788746171.110778:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448caf000 from 39 10000000:01000000:0.0:1788746171.110780:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746171.110809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.110826:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.110836:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.110874:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.110919:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.110956:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746171.111108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475840 00000100:00100000:2.0:1788746171.111115:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475840 00000100:00100000:2.0:1788746171.111155:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788746171.111175:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163475840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746171.111185:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746171.111197:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44800/0xe59b64da5b30997e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309977 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.111216:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44800/0xe59b64da5b30997e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309977 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.111226:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44800/0xe59b64da5b30997e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309977 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.111234:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44800, rc 0) 00000100:00100000:2.0:1788746171.111268:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163475840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746171.111274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788746171.111592:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.111606:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.111615:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.111678:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.111704:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.111724:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.111750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163475968 00000100:00100000:0.0:1788746171.111755:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163475968 00000100:00100000:0.0:1788746171.111780:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788746171.111786:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163475968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.112497:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163475968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 708us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.112506:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788746171.112527:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.112559:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.112605:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.112634:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746171.113076:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476096 00000100:00100000:2.0:1788746171.113088:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476096 00000100:00100000:2.0:1788746171.113119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788746171.113125:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163476096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746171.113304:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163476096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746171.113312:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788746171.113546:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.117295:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8485:1875636163476224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.117367:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.117424:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746171.118280:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476224 00000100:00100000:2.0:1788746171.118290:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476224 00000100:00100000:2.0:1788746171.118350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788746171.118358:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8485:x1875636163476224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746171.118635:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8485:x1875636163476224:12345-0@lo:502:llog_process_th.0 Request processed in 277us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746171.118642:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788746171.120960:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8485:1875636163476224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.121047:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8485:1875636163476352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.121114:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.121213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476352 00000100:00100000:1.0:1788746171.121221:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476352 00000100:00100000:1.0:1788746171.121276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788746171.121295:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8485:x1875636163476352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746171.121549:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8485:x1875636163476352:12345-0@lo:502:llog_process_th.0 Request processed in 263us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.121570:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788746171.123574:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.123613:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8485:1875636163476352:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788746171.123661:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788746171.126253:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788746171.126297:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788746171.126310:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.126324:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746171.126335:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788746171.126338:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788746171.126340:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788746171.126380:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.126388:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.126445:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.126478:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.126540:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.126581:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.126642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476480 00000100:00100000:0.0:1788746171.126650:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476480 00000100:00100000:1.0:1788746171.126981:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788746171.126995:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163476480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746171.127010:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746171.127024:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30998c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309985 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.127050:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30998c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309985 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.127060:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30998c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309985 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746171.127068:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479c00, rc 0) 00000100:00100000:1.0:1788746171.127121:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163476480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.127136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788746171.128933:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746171.128960:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.128970:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.129042:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.129092:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.129139:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.130735:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476608 00000100:00100000:0.0:1788746171.130749:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476608 00000100:00100000:0.0:1788746171.130809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788746171.130819:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163476608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.131193:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163476608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.131201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788746171.132195:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.132265:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.132327:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.132368:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.133623:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476736 00000100:00100000:0.0:1788746171.133633:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476736 00000100:00100000:0.0:1788746171.133674:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788746171.133683:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163476736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.133910:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163476736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.133918:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788746171.134013:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163476736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.136747:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8487:1875636163476864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746171.136820:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.136860:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345397a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.137303:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476864 00000100:00100000:0.0:1788746171.137310:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476864 00000100:00100000:0.0:1788746171.137363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788746171.137373:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8487:x1875636163476864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746171.137998:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8487:x1875636163476864:12345-0@lo:502:llog_process_th.0 Request processed in 624us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.138007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788746171.138129:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8487:1875636163476864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746171.138179:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746171.138189:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746171.138191:0:8487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788746171.138197:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788746171.138227:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8487:1875636163476992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746171.138291:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746171.138855:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746171.143851:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163476992 00000100:00100000:3.0:1788746171.143935:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163476992 00000100:00100000:3.0:1788746171.143997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788746171.144006:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8487:x1875636163476992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746171.145601:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8487:x1875636163476992:12345-0@lo:502:llog_process_th.0 Request processed in 1591us (7305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.145624:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788746171.145744:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8487:1875636163476992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746171.145785:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746171.145791:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746171.145794:0:8487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788746171.145798:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788746171.146136:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788746171.146156:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788746171.146178:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.146190:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746171.146199:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788746171.146201:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cd445093380 from 1 10000000:01000000:3.0:1788746171.146203:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788746171.146235:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.146244:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.146253:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.146272:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.146314:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.146353:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d4f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746171.146577:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477120 00000100:00100000:0.0:1788746171.146584:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477120 00000100:00100000:0.0:1788746171.146619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788746171.146628:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.146639:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746171.146652:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30999a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309993 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.146674:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30999a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309993 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.146683:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30999a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309993 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.146692:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09a600, rc 0) 00000100:00100000:0.0:1788746171.146731:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.146737:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788746171.146774:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.146787:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.146809:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746171.146860:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746171.146886:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746171.146915:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746171.146989:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477248 00000100:00100000:2.0:1788746171.146994:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477248 00000100:00100000:2.0:1788746171.147029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788746171.147036:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746171.147263:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746171.147271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788746171.147352:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163477248:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788746171.147375:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788746171.147381:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.147389:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788746171.256647:0:8499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda4e76330 20000000:00000080:3.0:1788746171.256667:0:8499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd47d742800 uarg=0000000000000000 20000000:01000000:3.0:1788746171.256702:0:8499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788746171.256708:0:8499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788746171.256713:0:8499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788746171.258181:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788746171.259289:0:8499:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788746171.267273:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788746171.267345:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788746171.267823:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788746171.267968:0:8499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746171.267988:0:8499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268006:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30970f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268013:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309771 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268020:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30983c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268029:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268036:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268076:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268095:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 9 pid: 5844 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.268109:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477376:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746171.268285:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268294:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 18 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.268316:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477504:0@lo:104: 00000100:00100000:2.0:1788746171.268356:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746171.268436:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268444:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 18 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.268453:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477632:0@lo:104: 00000100:00100000:2.0:1788746171.268489:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746171.268518:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.268525:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 18 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.268533:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477760:0@lo:104: 00000100:00100000:2.0:1788746171.268550:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45fb839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746171.268633:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788746171.268650:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.268662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477504 00000100:00100000:3.0:1788746171.268668:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477504 00000100:00100000:3.0:1788746171.268701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477632 00000100:00100000:3.0:1788746171.268704:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477632 00000100:00100000:3.0:1788746171.268712:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477760 00000100:00100000:3.0:1788746171.268714:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477760 00000100:00100000:3.0:1788746171.268725:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746171.268732:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:8499:x1875636163477504:12345-0@lo:104: 00010000:00010000:3.0:1788746171.268744:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.268799:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746171.268805:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+5:8499:x1875636163477504:12345-0@lo:104: Request processed in 74us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.268812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746171.268830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746171.268836:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45faf0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:8499:x1875636163477632:12345-0@lo:104: 00010000:00010000:3.0:1788746171.268844:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.268895:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788746171.268900:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45faf0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+4:8499:x1875636163477632:12345-0@lo:104: Request processed in 65us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.268906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746171.268934:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746171.268940:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:8499:x1875636163477760:12345-0@lo:104: 00010000:00010000:3.0:1788746171.268954:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.268990:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788746171.268995:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+3:8499:x1875636163477760:12345-0@lo:104: Request processed in 56us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.269002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788746171.269021:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788746171.269027:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269034:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09be00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746171.269038:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269047:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746171.269055:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746171.269060:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746171.269088:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269094:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746171.269114:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269121:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b30983c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309843 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269142:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746171.269145:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269150:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09a400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746171.269153:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269160:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746171.269166:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746171.269171:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746171.269187:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269192:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746171.269199:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269205:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b309771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309778 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269216:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746171.269219:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269235:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478200 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:3.0:1788746171.269238:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269245:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746171.269251:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746171.269256:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746171.269271:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269277:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746171.269292:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269299:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b30970f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269313:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746171.269315:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746171.269317:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746171.269323:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746171.269340:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163477888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746171.269368:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.269389:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746171.269395:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163478016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746171.269453:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.269491:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746171.269499:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163478144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746171.269520:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746171.269544:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163477888 00000100:00100000:3.0:1788746171.269549:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163477888 00010000:00010000:3.0:1788746171.269568:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 19 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.269585:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478016 00000100:00100000:3.0:1788746171.269587:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478016 00010000:00010000:3.0:1788746171.269597:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 20 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.269606:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478144 00000100:00100000:3.0:1788746171.269608:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478144 00010000:00010000:3.0:1788746171.269616:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 21 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.269627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746171.269633:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+21:3314:x1875636163477888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746171.269643:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746171.269647:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 21 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269655:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 21 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269667:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746171.269694:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+21:3314:x1875636163477888:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.269706:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746171.269720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746171.269726:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3314:x1875636163478016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746171.269733:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746171.269738:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 20 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269745:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 20 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269754:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746171.269774:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3314:x1875636163478016:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.269779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746171.269791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788746171.269797:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163478144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746171.269804:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746171.269808:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 19 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269816:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 19 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.269825:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746171.269852:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163478144:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.269858:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788746171.269892:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163478144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746171.269926:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163478016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746171.269933:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163477888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746171.270242:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479800/0xe59b64da5b309843 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30983c expref: 18 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.270253:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477504:0@lo:104: 00010000:00010000:2.0:1788746171.270262:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309771 expref: 17 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.270269:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477632:0@lo:104: 00010000:00010000:2.0:1788746171.270276:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440030a00/0xe59b64da5b309716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30970f expref: 16 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746171.270296:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477760:0@lo:104: 00010000:00010000:2.0:1788746171.273691:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746171.293423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746171.293548:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875636163477376:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746171.293582:0:8499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.295929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430400 00000100:00100000:3.0:1788746171.295944:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430400 00010000:00010000:3.0:1788746171.296001:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746171.296057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:3.0:1788746171.296068:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141430400:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746171.296083:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746171.296091:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296105:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296123:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f940000/0xe59b64da5b309900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b10d expref: 10 pid: 5844 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296141:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296148:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296166:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296173:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296192:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296199:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296205:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746171.296208:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296215:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296239:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746171.296252:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746171.296324:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:2349:x1875636141430400:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 258us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.296331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00010000:00010000:2.0:1788746171.299192:0:8499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.299211:0:8499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746171.299218:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44000/0xe59b64da5b3099a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746171.431498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746171.431970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430528 00000100:00100000:0.0:1788746171.431981:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430528 00000100:00100000:0.0:1788746171.432040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:0.0:1788746171.432051:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+9:5590:x1875636141430528:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746171.432069:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746171.432089:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b14c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.432117:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.432145:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746171.432154:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b400, rc 0) 00000100:00100000:0.0:1788746171.432203:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141430528:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 154us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.432210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:1.0:1788746171.444250:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746171.444381:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430656 00000100:00100000:3.0:1788746171.444391:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430656 00000100:00100000:3.0:1788746171.444476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 172 00000100:00100000:3.0:1788746171.444487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141430656:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746171.444758:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141430656:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 273us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.444766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 172 00000100:00100000:0.0:1788746171.462001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746171.464126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430784 00000100:00100000:1.0:1788746171.464140:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430784 00000100:00100000:1.0:1788746171.464234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 173 00000100:00100000:1.0:1788746171.464246:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141430784:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746171.464498:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:5590:x1875636141430784:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 253us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746171.464506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 173 00000100:00100000:1.0:1788746171.491282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746171.493841:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141430912 00000100:00100000:3.0:1788746171.493868:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141430912 00000100:00100000:3.0:1788746171.493937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 174 00000100:00100000:3.0:1788746171.493948:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:6087:x1875636141430912:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746171.496036:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:6087:x1875636141430912:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 2081us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746171.496051:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 174 00000100:00100000:1.0:1788746171.514876:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746171.515880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431040 00000100:00100000:0.0:1788746171.515893:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431040 00000100:00100000:0.0:1788746171.515956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 175 00000100:00100000:0.0:1788746171.515966:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:6087:x1875636141431040:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746171.516207:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:6087:x1875636141431040:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 240us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746171.516214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 175 00010000:00010000:0.0:1788746171.899750:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788746172.286014:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746172.286026:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd47ebce000 from 4 10000000:01000000:0.0:1788746172.286032:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746172.286090:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746172.286105:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746172.286120:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746172.286165:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746172.286257:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746172.286338:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.286628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478272 00000100:00100000:1.0:1788746172.286645:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478272 00000100:00100000:1.0:1788746172.286700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788746172.286710:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163478272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746172.286726:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746172.286742:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3099af expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.286772:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3099af expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.286784:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099af expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.286794:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479000, rc 0) 00000100:00100000:1.0:1788746172.286848:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.286854:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788746172.286920:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746172.286938:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.286947:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746172.287018:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.287047:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.287075:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477679b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.287088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478400 00000100:00100000:1.0:1788746172.287099:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478400 00000100:00100000:1.0:1788746172.287124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788746172.287130:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746172.298777:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 11631us (11713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746172.298799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788746172.307131:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.307227:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.307326:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.307497:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477679b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746172.318658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478528 00000100:00100000:0.0:1788746172.318679:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478528 00000100:00100000:0.0:1788746172.318764:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788746172.318777:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746172.325831:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7044us (18492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746172.325850:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788746172.329359:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.332387:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8522:1875636163478656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746172.332546:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.332594:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477679000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746172.332723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478656 00000100:00100000:0.0:1788746172.332732:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478656 00000100:00100000:0.0:1788746172.332791:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788746172.332802:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8522:x1875636163478656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746172.333326:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8522:x1875636163478656:12345-0@lo:502:llog_process_th.0 Request processed in 523us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746172.333335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788746172.333671:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8522:1875636163478656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746172.333805:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746172.333817:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746172.333820:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788746172.333831:0:8522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd47ebce000 00000020:00000080:3.0:1788746172.333834:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788746172.334072:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8522:1875636163478784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746172.334138:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.334189:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.334246:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478784 00000100:00100000:1.0:1788746172.334254:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478784 00000100:00100000:1.0:1788746172.334313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788746172.334323:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8522:x1875636163478784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746172.334583:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:8522:x1875636163478784:12345-0@lo:502:llog_process_th.0 Request processed in 260us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.334591:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788746172.338169:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8522:1875636163478784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746172.338234:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746172.338250:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746172.338252:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788746172.338261:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788746172.338806:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788746172.338838:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746172.338851:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.338866:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746172.338915:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746172.338918:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448dea800 from 4 10000000:01000000:1.0:1788746172.338922:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746172.338972:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.338981:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.338992:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746172.339021:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.339108:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.339152:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47743b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746172.342991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163478912 00000100:00100000:3.0:1788746172.343014:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163478912 00000100:00100000:3.0:1788746172.343098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788746172.343111:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163478912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746172.343135:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746172.343160:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3099bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.343219:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.343232:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.343242:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746172.343348:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163478912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.343355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788746172.343465:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163478912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746172.343488:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.343498:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746172.343598:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.343634:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.343672:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313600 going to sleep for 11 seconds 00000100:00100000:3.0:1788746172.343689:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479040 00000100:00100000:3.0:1788746172.343696:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479040 00000100:00100000:3.0:1788746172.344188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788746172.344197:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163479040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.344569:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163479040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.344588:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788746172.344644:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.344690:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.344870:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.344889:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313600 going to sleep for 11 seconds 00000100:00100000:3.0:1788746172.344993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479168 00000100:00100000:3.0:1788746172.345000:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479168 00000100:00100000:3.0:1788746172.345029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788746172.345037:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163479168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.345199:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163479168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.345206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788746172.345246:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746172.352515:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8523:1875636163479296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746172.352634:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.352690:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.353617:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479296 00000100:00100000:1.0:1788746172.353629:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479296 00000100:00100000:1.0:1788746172.353698:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788746172.354611:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8523:x1875636163479296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746172.354960:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8523:x1875636163479296:12345-0@lo:502:llog_process_th.0 Request processed in 355us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.360092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788746172.360195:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8523:1875636163479296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746172.360247:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746172.360260:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746172.360262:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788746172.360273:0:8523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448dea800 00000020:00000080:3.0:1788746172.360276:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788746172.361568:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8523:1875636163479424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746172.361689:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.362604:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd446313780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.362795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479424 00000100:00100000:1.0:1788746172.362810:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479424 00000100:00100000:1.0:1788746172.362886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788746172.362966:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8523:x1875636163479424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746172.363268:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:8523:x1875636163479424:12345-0@lo:502:llog_process_th.0 Request processed in 371us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.363282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788746172.363529:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8523:1875636163479424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746172.363569:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746172.363578:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746172.363581:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788746172.363590:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788746172.364574:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788746172.364606:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746172.364619:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.364633:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746172.364644:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746172.364647:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448caf000 from 4 10000000:01000000:1.0:1788746172.364650:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746172.364692:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.365011:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.365027:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746172.365056:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.365130:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.365216:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4461a0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746172.368349:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479552 00000100:00100000:3.0:1788746172.368369:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479552 00000100:00100000:3.0:1788746172.368515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788746172.368528:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163479552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746172.368549:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746172.368572:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b3099cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.368608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.368621:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746172.368631:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746172.369157:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163479552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 631us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.369166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788746172.376500:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746172.376541:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746172.376558:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746172.376886:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.376967:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.377012:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4461a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.377037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479680 00000100:00100000:1.0:1788746172.377044:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479680 00000100:00100000:1.0:1788746172.377089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788746172.377098:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163479680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.377390:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163479680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.378783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788746172.378877:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.379048:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746172.379122:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746172.379171:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eba7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746172.379232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479808 00000100:00100000:0.0:1788746172.379241:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479808 00000100:00100000:0.0:1788746172.379440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788746172.379465:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163479808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746172.379688:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163479808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746172.379701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788746172.379875:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163479808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746172.381558:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8528:1875636163479936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746172.381646:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746172.381696:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746172.382850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163479936 00000100:00100000:1.0:1788746172.382866:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163479936 00000100:00100000:1.0:1788746172.382937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788746172.382947:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:8528:x1875636163479936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746172.383235:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:8528:x1875636163479936:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746172.383245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788746172.383346:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8528:1875636163479936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746172.383392:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746172.383423:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746172.383426:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788746172.383434:0:8528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448caf000 00000020:00000080:0.0:1788746172.383437:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788746172.383557:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8528:1875636163480064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746172.383603:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746172.383644:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788746172.384179:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480064 00000100:00100000:3.0:1788746172.384189:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480064 00000100:00100000:3.0:1788746172.384242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788746172.384253:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:8528:x1875636163480064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746172.384695:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:8528:x1875636163480064:12345-0@lo:502:llog_process_th.0 Request processed in 442us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.384722:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788746172.391215:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:8528:1875636163480064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746172.391280:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746172.391290:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746172.391293:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788746172.391298:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788746172.391465:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788746172.391491:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788746172.391505:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746172.391518:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746172.859874:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163480192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746172.859945:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746172.860068:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480192 00000100:00100000:3.0:1788746172.860077:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480192 00000100:00100000:3.0:1788746172.860139:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788746172.860149:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163480192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746172.860184:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788746172.860607:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746172.865110:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163480192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4955us (5156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746172.865124:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788746172.865270:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d1c00 x1875636163480192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746172.865297:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163480192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788746172.933455:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746173.948636:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746174.907051:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163480448:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907143:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907192:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163480960:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907220:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907251:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788746174.907258:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163480320:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907284:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907304:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163480832:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907325:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907363:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163480576:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907386:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907447:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746174.907454:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163480704:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907476:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746174.907512:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480448 00000100:00100000:0.0:1788746174.907520:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480448 00000100:00100000:0.0:1788746174.907556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480832 00000100:00100000:0.0:1788746174.907560:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480832 00000100:00100000:0.0:1788746174.907587:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480576 00000100:00100000:0.0:1788746174.907589:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480576 00000100:00100000:0.0:1788746174.907607:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746174.907616:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163480448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.907665:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163480448:12345-0@lo:400:kworker.0 Request processed in 49us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908109:0:5850:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788746174.908119:0:5850:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788746174.908134:0:5851:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788746174.908142:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788746174.908150:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163480832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908189:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163480832:12345-0@lo:400:kworker.0 Request processed in 40us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788746174.908212:0:5851:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788746174.908218:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788746174.908224:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163480576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908258:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163480576:12345-0@lo:400:kworker.0 Request processed in 34us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788746174.908282:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480320 00000100:00100000:3.0:1788746174.908286:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480320 00000100:00100000:3.0:1788746174.908326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788746174.908333:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163480320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908366:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163480320:12345-0@lo:400:kworker.0 Request processed in 33us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788746174.908416:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480960 00000100:00100000:3.0:1788746174.908420:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480960 00000100:00100000:3.0:1788746174.908459:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163480704 00000100:00100000:3.0:1788746174.908462:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163480704 00000100:00100000:3.0:1788746174.908483:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746174.908490:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163480960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908519:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163480960:12345-0@lo:400:kworker.0 Request processed in 31us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746174.908537:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746174.908543:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163480704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908570:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163480704:12345-0@lo:400:kworker.0 Request processed in 28us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746174.908575:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788746174.908607:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746174.908611:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746174.908614:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746174.908768:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908785:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163480832:0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.908796:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163480448:0@lo:400:kworker.0 00010000:00080000:3.0:1788746174.908808:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb52300 x1875636163480960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746174.908828:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163480960:0@lo:400:kworker.0 00010000:00080000:3.0:1788746174.909002:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb51880 x1875636163480704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746174.909011:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163480704:0@lo:400:kworker.0 00000100:00100000:3.0:1788746174.909020:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163480576:0@lo:400:kworker.0 00000100:00100000:0.0:1788746174.909291:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788746174.970847:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746175.419334:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746175.419357:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746175.419468:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746175.420249:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481088 00000100:00100000:0.0:1788746175.420259:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481088 00000100:00100000:0.0:1788746175.420313:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746175.420322:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163481088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746175.420354:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746175.420452:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163481088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746175.420459:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788746175.420825:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb52a00 x1875636163481088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746175.420846:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746175.510831:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746175.510880:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746175.511001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746175.511033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746175.511082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431168 00000100:00100000:3.0:1788746175.511093:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431168 00000100:00100000:3.0:1788746175.511145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 192 00000100:00100000:3.0:1788746175.511156:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141431168:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746175.511222:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141431168:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746175.511229:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 192 00000100:00100000:0.0:1788746175.511614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431296 00000100:00100000:0.0:1788746175.511620:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431296 00000100:00100000:0.0:1788746175.511678:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:0.0:1788746175.511686:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141431296:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746175.511743:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141431296:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 58us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746175.511751:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00080000:3.0:1788746175.515092:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746175.515768:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431552 00000100:00100000:2.0:1788746175.515796:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431552 00000100:00100000:3.0:1788746175.520282:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431424 00000100:00100000:3.0:1788746175.520297:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431424 00000100:00080000:0.0:1788746175.520421:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746175.520425:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746175.522084:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:2.0:1788746175.522106:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431552:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746175.522183:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431552:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 87us (11303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746175.522191:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:3.0:1788746175.525034:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:3.0:1788746175.525047:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431424:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746175.525121:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431424:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 76us (14086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746175.525128:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00010000:00010000:0.0:1788746175.994972:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746177.018588:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746177.987318:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746177.987343:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163481216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746177.987464:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746177.987618:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481216 00000100:00100000:0.0:1788746177.987626:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481216 00000100:00100000:0.0:1788746177.987692:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746177.987702:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163481216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746177.987738:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746177.987788:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163481216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746177.987796:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788746177.987840:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0e00 x1875636163481216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746177.987860:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163481216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788746177.988058:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788746178.043715:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746179.080919:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746179.091289:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788746180.028970:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163481472:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029037:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029081:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163481984:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029117:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029149:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788746180.029155:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163481344:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029205:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163481856:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029226:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029251:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163481600:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029272:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029290:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746180.029295:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163481728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029314:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746180.029341:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481472 00000100:00100000:3.0:1788746180.029347:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481472 00000100:00100000:3.0:1788746180.029609:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481856 00000100:00100000:3.0:1788746180.029614:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481856 00000100:00100000:3.0:1788746180.029711:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481600 00000100:00100000:3.0:1788746180.029714:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481600 00000100:00100000:3.0:1788746180.029733:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788746180.029741:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163481472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029793:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163481472:12345-0@lo:400:kworker.0 Request processed in 53us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.029809:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788746180.029826:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746180.029831:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163481856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029861:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163481856:12345-0@lo:400:kworker.0 Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.029866:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746180.029878:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788746180.029883:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163481600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.029913:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163481600:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.029918:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788746180.029936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481344 00000100:00100000:3.0:1788746180.029995:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481344 00000100:00100000:3.0:1788746180.030021:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788746180.030028:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163481344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030054:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163481344:12345-0@lo:400:kworker.0 Request processed in 28us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.030061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788746180.030093:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481984 00000100:00100000:3.0:1788746180.030097:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481984 00000100:00100000:3.0:1788746180.030122:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163481728 00000100:00100000:3.0:1788746180.030125:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163481728 00000100:00100000:3.0:1788746180.030144:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746180.030149:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163481984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030178:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163481984:12345-0@lo:400:kworker.0 Request processed in 28us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.030192:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746180.030204:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746180.030210:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163481728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030237:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163481728:12345-0@lo:400:kworker.0 Request processed in 27us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.030242:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788746180.030260:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746180.030263:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746180.030266:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788746180.030298:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001e300 x1875636163481728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746180.030312:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163481728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030323:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163481600:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030350:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163481344:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030358:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163481856:0@lo:400:kworker.0 00000100:00100000:3.0:1788746180.030367:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163481472:0@lo:400:kworker.0 00010000:00080000:3.0:1788746180.030375:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001e680 x1875636163481984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746180.030688:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163481984:0@lo:400:kworker.0 00010000:00010000:2.0:1788746180.090698:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746180.538699:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746180.538723:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163482112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746180.538791:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746180.538960:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482112 00000100:00100000:0.0:1788746180.538968:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482112 00000100:00100000:0.0:1788746180.539025:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788746180.539035:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163482112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746180.539069:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746180.539119:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163482112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746180.539125:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788746180.539715:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb53800 x1875636163482112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746180.539734:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163482112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746180.631830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746180.631888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746180.631931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746180.631992:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746180.632050:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432064 00000100:00100000:2.0:1788746180.632058:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431680 00000100:00100000:1.0:1788746180.632063:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432064 00000100:00100000:2.0:1788746180.632074:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431680 00000100:00100000:1.0:1788746180.632158:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431936 00000100:00100000:1.0:1788746180.632164:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431936 00000100:00100000:2.0:1788746180.632169:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 194 00000100:00100000:2.0:1788746180.632182:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141431680:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746180.632266:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141431680:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746180.632273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 194 00000100:00100000:3.0:1788746180.632329:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141431808 00000100:00100000:3.0:1788746180.632335:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141431808 00000100:00100000:3.0:1788746180.632443:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:3.0:1788746180.632457:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141431808:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:2.0:1788746180.632511:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788746180.632519:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746180.632552:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141431808:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 97us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.632561:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:3.0:1788746180.632607:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:3.0:1788746180.632616:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141432064:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746180.632643:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141432064:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 29us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746180.632650:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:1.0:1788746180.633020:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:1.0:1788746180.633040:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431936:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746180.633084:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141431936:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 45us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746180.633091:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00080000:2.0:1788746180.633844:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788746181.114648:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746182.139148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746183.098705:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746183.098735:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163482240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746183.098823:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746183.098902:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482240 00000100:00100000:3.0:1788746183.098912:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482240 00000100:00100000:3.0:1788746183.100922:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746183.100942:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163482240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746183.100996:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746183.101096:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163482240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746183.101104:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788746183.101161:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450080e00 x1875636163482240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746183.101183:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163482240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788746183.103114:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746183.166865:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746184.186998:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746185.153895:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163482368:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154006:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154102:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154132:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788746185.154138:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163482496:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154162:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154180:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163483008:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154206:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154235:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163482752:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154259:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154277:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746185.154283:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163482624:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.154306:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746185.154337:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483008 00000100:00100000:0.0:1788746185.154346:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483008 00000100:00100000:3.0:1788746185.155921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482368 00000100:00100000:3.0:1788746185.155953:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482368 00000100:00100000:0.0:1788746185.155997:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482752 00000100:00100000:0.0:1788746185.156005:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482752 00000100:00100000:3.0:1788746185.156019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788746185.156032:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163482368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.156060:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788746185.156071:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163483008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.156138:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163482368:12345-0@lo:400:kworker.0 Request processed in 109us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746185.156199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788746185.156241:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482880 00000100:00100000:3.0:1788746185.156246:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482880 00000100:00100000:3.0:1788746185.156273:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482496 00000100:00100000:3.0:1788746185.156277:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482496 00000100:00100000:3.0:1788746185.156288:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163482624 00000100:00100000:3.0:1788746185.156291:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163482624 00000100:00100000:3.0:1788746185.156305:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788746185.156310:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.156344:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163482880:12345-0@lo:400:kworker.0 Request processed in 34us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746185.156454:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788746185.156468:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788746185.156474:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163482496:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788746185.158121:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746185.158135:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746185.158138:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746185.158169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746185.158192:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163482624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.160127:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163482496:12345-0@lo:400:kworker.0 Request processed in 3643us (5954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746185.160144:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788746185.160211:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746185.160300:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163482752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.160387:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163482752:12345-0@lo:400:kworker.0 Request processed in 81us (6115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746185.160394:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788746185.160551:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb51880 x1875636163482752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746185.160569:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163482752:0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.160611:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163482496:0@lo:400:kworker.0 00010000:00080000:3.0:1788746185.160626:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb51500 x1875636163483008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746185.160635:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.160647:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163482368:0@lo:400:kworker.0 00000100:00100000:3.0:1788746185.160661:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788746185.165790:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163483008:12345-0@lo:400:kworker.0 Request processed in 9706us (11566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746185.165811:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746185.166941:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163482624:12345-0@lo:400:kworker.0 Request processed in 8753us (12625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746185.166956:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788746185.168135:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163482624:0@lo:400:kworker.0 00010000:00010000:0.0:1788746185.215000:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746185.500941:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing yml_node 00000100:00100000:1.0:1788746185.663688:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163483136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746185.663753:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746185.665198:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483136 00000100:00100000:1.0:1788746185.665209:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483136 00000100:00100000:1.0:1788746185.665258:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788746185.665269:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163483136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746185.665310:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746185.665421:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163483136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746185.665428:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788746185.665468:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd476fdd180 x1875636163483136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746185.665487:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163483136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746185.766526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746185.766571:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746185.766603:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432320 00000100:00100000:2.0:1788746185.766613:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432320 00000100:00100000:2.0:1788746185.766682:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:2.0:1788746185.766692:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141432320:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746185.766761:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141432320:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746185.766767:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:0.0:1788746185.767240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432192 00000100:00100000:0.0:1788746185.767246:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432192 00000100:00100000:0.0:1788746185.767295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 196 00000100:00100000:0.0:1788746185.767303:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2350:x1875636141432192:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746185.767342:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2350:x1875636141432192:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746185.767359:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 196 00000100:00080000:0.0:1788746185.769496:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746185.775507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746185.775673:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432448 00000100:00100000:1.0:1788746185.775683:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432448 00000100:00100000:1.0:1788746185.775756:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746185.775766:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2346:x1875636141432448:12345-192.168.206.24@tcp:9:kworker.0 00000020:00000080:1.0:1788746185.775802:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30990e 00000100:00080000:1.0:1788746185.775811:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746185.775850:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788746185.776190:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+2:2346:x1875636141432448:12345-192.168.206.24@tcp:9:kworker.0 Request processed in 424us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746185.776198:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00010000:00010000:1.0:1788746185.776222:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788746185.776881:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746185.777655:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746185.777720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432576 00000100:00100000:3.0:1788746185.777728:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432576 00000100:00100000:3.0:1788746185.777788:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746185.777797:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2346:x1875636141432576:12345-192.168.206.24@tcp:9:kworker.0 00000020:00000080:3.0:1788746185.777827:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309915 00000100:00080000:3.0:1788746185.777836:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746185.777866:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788746185.778228:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+2:2346:x1875636141432576:12345-192.168.206.24@tcp:9:kworker.0 Request processed in 431us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746185.778236:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00010000:00010000:1.0:1788746185.778750:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746185.778757:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788746186.235622:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746187.258630:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746188.218647:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746188.218670:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746188.218736:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746188.218969:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483264 00000100:00100000:3.0:1788746188.218977:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483264 00000100:00100000:3.0:1788746188.219060:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746188.219070:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163483264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746188.219103:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746188.219159:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163483264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746188.219167:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788746188.219214:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450080700 x1875636163483264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746188.219233:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163483264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788746188.219718:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746188.282679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746189.307334:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788746189.868506:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:0.0:1788746189.868519:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cd45f4f5000/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:2.0:1788746189.871588:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f4f5000/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-OST0001 00000020:00000080:0.0:1788746189.871790:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45f4f3000 for lustre-OST0001 00000001:02000400:2.0:1788746189.935944:0:9237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:1.0:1788746190.267051:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163483392:0@lo:400:kworker.0 00000100:00100000:1.0:1788746190.267143:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746190.267769:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483392 00000100:00100000:1.0:1788746190.267780:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483392 00000100:00100000:1.0:1788746190.267842:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788746190.267853:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746190.267925:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163483392:12345-0@lo:400:kworker.0 Request processed in 74us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746190.267935:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788746190.267991:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163483392:0@lo:400:kworker.0 00000100:00100000:2.0:1788746190.268259:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163483776:0@lo:400:kworker.0 00000100:00100000:2.0:1788746190.268300:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746190.268457:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746190.268573:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163483520:0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.268618:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746190.268784:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163484032:0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.268826:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746190.268854:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746190.268861:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163483904:0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.268891:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746190.268930:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483520 00000100:00100000:3.0:1788746190.268935:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483520 00000100:00100000:3.0:1788746190.268993:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483904 00000100:00100000:3.0:1788746190.269003:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483904 00000100:00100000:3.0:1788746190.269055:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746190.269065:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163483520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.269130:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163483520:12345-0@lo:400:kworker.0 Request processed in 67us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746190.269137:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746190.269152:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746190.269157:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163483904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.269201:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163483904:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746190.269224:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746190.269276:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163483904:0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.269287:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163483520:0@lo:400:kworker.0 00000100:00100000:2.0:1788746190.269365:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163483648:0@lo:400:kworker.0 00000100:00100000:2.0:1788746190.269431:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746190.269733:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483776 00000100:00100000:1.0:1788746190.269739:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483776 00000100:00100000:1.0:1788746190.269781:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484032 00000100:00100000:1.0:1788746190.269784:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484032 00000100:00100000:1.0:1788746190.269872:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746190.269880:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163483776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746190.269931:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163483776:12345-0@lo:400:kworker.0 Request processed in 52us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746190.269944:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746190.269958:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746190.269965:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163484032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746190.270013:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163484032:12345-0@lo:400:kworker.0 Request processed in 49us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746190.270019:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746190.270083:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163483648 00000100:00100000:3.0:1788746190.270088:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163483648 00000100:00100000:3.0:1788746190.270116:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788746190.270123:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746190.270170:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163483648:12345-0@lo:400:kworker.0 Request processed in 48us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746190.270176:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746190.271315:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163483648:0@lo:400:kworker.0 00010000:00080000:2.0:1788746190.271372:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08ca80 x1875636163483776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746190.271385:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163483776:0@lo:400:kworker.0 00010000:00080000:2.0:1788746190.274742:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08d880 x1875636163484032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746190.274771:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163484032:0@lo:400:kworker.0 00000100:00080000:2.0:1788746190.274805:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746190.274811:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746190.274815:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788746190.296386:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:3.0:1788746190.296848:0:6706:0:(genops.c:885:class_export_put()) final put ffff9cd45f4f4000/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:2.0:1788746190.296929:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f4f4000/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-OST0000 00000020:00000080:2.0:1788746190.297057:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45f4f0000 for lustre-OST0000 00010000:00010000:3.0:1788746190.333509:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746190.789734:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746190.789806:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746190.789910:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484160 00000100:00100000:2.0:1788746190.789926:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484160 00000100:00100000:2.0:1788746190.790073:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788746190.790084:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746190.790117:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746190.790173:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746190.790180:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788746190.790257:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08d880 x1875636163484160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746190.790277:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746190.876891:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746190.876957:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746190.876991:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432832 00000100:00100000:1.0:1788746190.877000:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432832 00000100:00100000:1.0:1788746190.877062:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:1.0:1788746190.877073:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141432832:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746190.877145:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141432832:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746190.877152:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:3.0:1788746190.877505:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432704 00000100:00100000:3.0:1788746190.877511:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432704 00000100:00100000:3.0:1788746190.877544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 198 00000100:00100000:3.0:1788746190.877552:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141432704:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746190.877590:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141432704:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 38us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746190.877596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 198 00000100:00080000:2.0:1788746190.880805:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788746191.355053:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746192.379679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746192.416037:0:9337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:3.0:1788746193.338806:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746193.338828:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746193.338891:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746193.338948:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484288 00000100:00100000:3.0:1788746193.338955:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484288 00000100:00100000:3.0:1788746193.339009:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746193.339018:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746193.339049:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746193.339091:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746193.339098:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788746193.339150:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450083100 x1875636163484288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746193.339166:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788746193.339631:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746193.405229:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746194.427506:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746194.942326:0:9434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1788746195.388388:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788746195.388483:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746195.388664:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484416 00000100:00100000:2.0:1788746195.388672:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484416 00000100:00100000:2.0:1788746195.388717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788746195.388727:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163484416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746195.389971:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163484544:0@lo:400:kworker.0 00000100:00100000:1.0:1788746195.390020:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746195.390361:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484544 00000100:00100000:1.0:1788746195.390368:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484544 00000100:00100000:1.0:1788746195.390438:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746195.390447:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163484544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746195.390497:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163484544:12345-0@lo:400:kworker.0 Request processed in 51us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746195.390503:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746195.390538:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163484544:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.390905:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163484416:12345-0@lo:400:kworker.0 Request processed in 2178us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746195.390914:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788746195.391015:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163484416:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.391526:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746195.391586:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746195.391599:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484800:0@lo:400:kworker.0 00000100:00100000:0.0:1788746195.391654:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746195.391732:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484800 00000100:00100000:1.0:1788746195.391738:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484800 00000100:00100000:1.0:1788746195.391792:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788746195.391800:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746195.391842:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163484800:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746195.391857:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788746195.391919:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788746195.391941:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450081180 x1875636163484800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746195.391952:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163484800:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.391993:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.392021:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746195.392085:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484672 00000100:00100000:1.0:1788746195.392089:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484672 00000100:00100000:1.0:1788746195.392157:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788746195.392164:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163484672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746195.392198:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163484672:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746195.392204:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788746195.392589:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163484928:0@lo:400:kworker.0 00000100:00100000:3.0:1788746195.392619:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746195.392639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746195.392644:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163485056:0@lo:400:kworker.0 00000100:00100000:3.0:1788746195.392666:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746195.392688:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163484928 00000100:00100000:3.0:1788746195.392692:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163484928 00000100:00100000:2.0:1788746195.392811:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.392830:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485056 00000100:00100000:2.0:1788746195.392834:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485056 00000100:00080000:0.0:1788746195.392886:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746195.392890:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746195.393069:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788746195.393078:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163484928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746195.393119:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163484928:12345-0@lo:400:kworker.0 Request processed in 42us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746195.393125:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746195.393235:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788746195.393242:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163485056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.393284:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163485056:12345-0@lo:400:kworker.0 Request processed in 43us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746195.393299:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788746195.393359:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450081500 x1875636163485056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746195.393370:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163485056:0@lo:400:kworker.0 00000100:00100000:2.0:1788746195.393384:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163484928:0@lo:400:kworker.0 00010000:00010000:0.0:1788746195.451351:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746195.904432:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163485184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746195.904501:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746195.905797:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485184 00000100:00100000:0.0:1788746195.905811:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485184 00000100:00100000:0.0:1788746195.905877:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788746195.905887:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163485184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746195.905923:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746195.906002:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163485184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746195.906009:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788746195.909967:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08d180 x1875636163485184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746195.909995:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163485184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746195.992757:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746195.992813:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746195.992902:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141432960 00000100:00100000:2.0:1788746195.992911:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141432960 00000100:00100000:2.0:1788746195.992967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 200 00000100:00100000:2.0:1788746195.992977:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2350:x1875636141432960:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746195.993054:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2350:x1875636141432960:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746195.993062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 200 00000100:00100000:3.0:1788746195.993517:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433088 00000100:00100000:3.0:1788746195.993523:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433088 00000100:00100000:3.0:1788746195.993585:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:3.0:1788746195.993593:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141433088:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746195.993650:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141433088:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 58us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746195.993658:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00080000:0.0:1788746195.993920:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788746196.480721:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788746196.812183:0:9482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 21:56:35 EDT 2026 00010000:00010000:1.0:1788746197.498838:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746198.458704:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163485312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746198.458779:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746198.458883:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485312 00000100:00100000:3.0:1788746198.458891:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485312 00000100:00100000:3.0:1788746198.458960:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746198.458968:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163485312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746198.459003:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746198.459046:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163485312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746198.459053:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788746198.459100:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788746198.459126:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450083100 x1875636163485312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746198.459143:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163485312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788746198.522601:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746199.547695:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746200.508507:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.508574:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746200.508634:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746200.508640:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163485824:0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.508665:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746200.508698:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485696 00000100:00100000:0.0:1788746200.508704:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485696 00000100:00100000:0.0:1788746200.508752:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788746200.508761:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163485696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.508804:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163485696:12345-0@lo:400:kworker.0 Request processed in 45us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746200.508823:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788746200.508844:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485824 00000100:00100000:0.0:1788746200.508848:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485824 00000100:00100000:0.0:1788746200.508873:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788746200.508879:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163485824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.508908:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163485824:12345-0@lo:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746200.508913:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788746200.508926:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746200.508930:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788746200.508973:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a5880 x1875636163485824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746200.508988:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163485824:0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.508997:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163485696:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509195:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509231:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746200.509264:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163485952:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509296:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746200.509318:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746200.509324:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163485568:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509345:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746200.509361:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163486080:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509379:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746200.509437:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485952 00000100:00100000:2.0:1788746200.509442:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485952 00000100:00100000:2.0:1788746200.509472:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485568 00000100:00100000:2.0:1788746200.509475:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485568 00000100:00100000:2.0:1788746200.509487:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788746200.509493:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163485952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509526:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163485952:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746200.509531:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788746200.509550:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746200.509555:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163485568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509580:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163485568:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746200.509585:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746200.509603:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486080 00000100:00100000:2.0:1788746200.509607:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486080 00000100:00100000:2.0:1788746200.509630:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788746200.509636:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163486080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509663:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163486080:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746200.509668:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788746200.509685:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746200.509688:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746200.509708:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163485568:0@lo:400:kworker.0 00010000:00080000:2.0:1788746200.509718:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a6300 x1875636163486080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746200.509726:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163486080:0@lo:400:kworker.0 00000100:00100000:2.0:1788746200.509745:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163485952:0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.513352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163485440 00000100:00100000:0.0:1788746200.513366:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163485440 00000100:00100000:0.0:1788746200.513449:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788746200.513458:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746200.513547:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163485440:12345-0@lo:400:kworker.0 Request processed in 91us (4314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746200.513554:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788746200.513594:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163485440:0@lo:400:kworker.0 00010000:00010000:2.0:1788746200.570732:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746201.018955:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746201.018979:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746201.019042:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746201.019215:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486208 00000100:00100000:2.0:1788746201.019223:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486208 00000100:00100000:2.0:1788746201.019297:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746201.019306:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163486208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746201.019339:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746201.019393:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163486208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (351us total) trans 0 rc 0/0 00010000:00080000:3.0:1788746201.019632:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd477b6e680 x1875636163486208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746201.019652:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746201.019717:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746201.125829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746201.125879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746201.125907:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433344 00000100:00100000:2.0:1788746201.125915:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433344 00000100:00100000:2.0:1788746201.125975:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:2.0:1788746201.125984:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141433344:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746201.126053:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141433344:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746201.126060:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:0.0:1788746201.126483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433216 00000100:00100000:0.0:1788746201.126489:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433216 00000100:00100000:0.0:1788746201.126522:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 202 00000100:00100000:0.0:1788746201.126529:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141433216:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746201.126577:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141433216:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 49us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746201.126584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 202 00000100:00080000:0.0:1788746201.126625:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788746201.597376:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746202.618562:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746203.578751:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163486336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746203.578817:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746203.578890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486336 00000100:00100000:3.0:1788746203.578897:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486336 00000100:00100000:3.0:1788746203.578956:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746203.578966:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163486336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746203.579009:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746203.579072:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163486336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746203.579080:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788746203.579101:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746203.579131:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450080700 x1875636163486336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746203.579149:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163486336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788746203.644676:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746204.670026:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746205.628237:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163486592:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628324:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628375:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163487104:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628461:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628491:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788746205.628497:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163486464:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628525:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628544:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163486976:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628583:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628610:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163486720:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628633:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628651:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746205.628656:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163486848:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628677:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746205.628705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486592 00000100:00100000:3.0:1788746205.628712:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486592 00000100:00100000:3.0:1788746205.628757:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486976 00000100:00100000:3.0:1788746205.628761:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486976 00000100:00100000:3.0:1788746205.628787:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486720 00000100:00100000:3.0:1788746205.628790:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486720 00000100:00100000:3.0:1788746205.628815:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788746205.628826:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163486592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.628830:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487104 00000100:00100000:0.0:1788746205.628837:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487104 00000100:00100000:3.0:1788746205.628881:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163486592:12345-0@lo:400:kworker.0 Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746205.628889:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788746205.628908:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746205.628915:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163486976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.628947:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163486976:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746205.628953:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746205.628966:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788746205.628975:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163486720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.629009:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163486720:12345-0@lo:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746205.629016:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788746205.629043:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746205.629047:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486848 00000100:00080000:3.0:1788746205.629049:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746205.629053:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486848 00000100:00100000:3.0:1788746205.629080:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163486720:0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.629091:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788746205.629101:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163487104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.629117:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163486976:0@lo:400:kworker.0 00000100:00100000:3.0:1788746205.629130:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163486592:0@lo:400:kworker.0 00010000:00080000:3.0:1788746205.629146:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb52300 x1875636163487104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746205.629148:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163487104:12345-0@lo:400:kworker.0 Request processed in 48us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746205.629163:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788746205.629178:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788746205.629181:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163487104:0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.629189:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163486848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.629223:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163486848:12345-0@lo:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746205.629231:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788746205.629251:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450080a80 x1875636163486848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746205.629271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163486464 00000100:00100000:3.0:1788746205.629274:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163486848:0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.629277:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163486464 00000100:00100000:0.0:1788746205.629305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788746205.629313:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746205.629353:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163486464:12345-0@lo:400:kworker.0 Request processed in 41us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746205.629359:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788746205.631929:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163486464:0@lo:400:kworker.0 00000100:00080000:0.0:1788746205.633117:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746205.690644:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746206.140220:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746206.140243:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163487232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746206.140333:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746206.142148:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487232 00000100:00100000:3.0:1788746206.142160:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487232 00000100:00100000:3.0:1788746206.142230:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788746206.142240:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163487232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746206.142290:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746206.142377:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163487232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746206.142384:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788746206.142444:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4446d0e00 x1875636163487232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746206.142463:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163487232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746206.231603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746206.231778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746206.231859:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433600 00000100:00100000:3.0:1788746206.231868:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433600 00000100:00100000:3.0:1788746206.231947:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:3.0:1788746206.231959:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141433600:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746206.232042:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141433600:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746206.232049:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00080000:1.0:1788746206.232171:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746206.237096:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433472 00000100:00100000:0.0:1788746206.237110:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433472 00000100:00100000:0.0:1788746206.237181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 204 00000100:00100000:0.0:1788746206.237192:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141433472:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746206.238109:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2347:x1875636141433472:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 914us (6624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746206.238119:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 204 00010000:00010000:3.0:1788746206.717539:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746207.738670:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746208.702283:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746208.702305:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163487360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746208.702364:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746208.702447:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487360 00000100:00100000:1.0:1788746208.702454:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487360 00000100:00100000:1.0:1788746208.702559:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788746208.702569:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163487360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746208.702600:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746208.702647:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163487360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746208.702664:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788746208.702683:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788746208.706642:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd477b6ed80 x1875636163487360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746208.706679:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163487360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746208.764298:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746209.792859:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746210.746722:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.746789:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163487488:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.746795:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746210.746838:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746210.746863:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746210.746875:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163488000:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.746876:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163487872:0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.746915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746210.746923:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746210.746939:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746210.746948:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163487616:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.746966:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487744 00000100:00100000:0.0:1788746210.746974:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487744 00000100:00100000:2.0:1788746210.746975:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746210.746996:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163488128:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747024:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488000 00000100:00100000:0.0:1788746210.747028:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488000 00000100:00100000:0.0:1788746210.747042:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487616 00000100:00100000:0.0:1788746210.747044:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487616 00000100:00100000:2.0:1788746210.747069:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746210.747082:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788746210.747093:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163487744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.747119:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487872 00000100:00100000:2.0:1788746210.747125:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487872 00000100:00100000:0.0:1788746210.747148:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163487744:12345-0@lo:400:kworker.0 Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746210.747157:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788746210.747158:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488128 00000100:00100000:2.0:1788746210.747162:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488128 00000100:00100000:0.0:1788746210.747180:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746210.747189:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788746210.747192:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163488000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.747213:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163487872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747247:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163488000:12345-0@lo:400:kworker.0 Request processed in 59us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746210.747263:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163487872:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746210.747271:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746210.747287:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788746210.747290:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788746210.747298:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163487616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.747314:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746210.747323:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163488128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747333:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163487616:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746210.747340:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746210.747358:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163488128:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746210.747365:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746210.747428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163487488 00000100:00100000:2.0:1788746210.747432:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163487488 00010000:00080000:0.0:1788746210.747449:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4700 x1875636163487872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746210.747457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788746210.747468:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747471:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163487872:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747488:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788746210.747508:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163487488:12345-0@lo:400:kworker.0 Request processed in 40us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746210.747516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788746210.747527:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163487616:0@lo:400:kworker.0 00010000:00080000:0.0:1788746210.747541:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a6d80 x1875636163488128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746210.747551:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163488128:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747559:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163487488:0@lo:400:kworker.0 00000100:00100000:0.0:1788746210.747568:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163488000:0@lo:400:kworker.0 00000100:00080000:1.0:1788746210.747942:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746210.747947:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746210.747950:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788746210.810631:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746211.259505:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746211.259572:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746211.259774:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488256 00000100:00100000:3.0:1788746211.259783:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488256 00000100:00100000:3.0:1788746211.259831:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788746211.259841:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163488256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746211.259877:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746211.259934:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163488256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746211.259941:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788746211.260056:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb53480 x1875636163488256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746211.260074:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746211.352715:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746211.352806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746211.352884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433728 00000100:00100000:1.0:1788746211.352893:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433728 00000100:00100000:1.0:1788746211.352955:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 206 00000100:00100000:1.0:1788746211.352966:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2348:x1875636141433728:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746211.353041:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2348:x1875636141433728:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746211.353048:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 206 00000100:00100000:3.0:1788746211.353382:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433856 00000100:00100000:3.0:1788746211.353387:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433856 00000100:00100000:3.0:1788746211.353454:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:3.0:1788746211.353500:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141433856:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746211.353541:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141433856:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 42us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746211.353547:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00080000:1.0:1788746211.353741:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788746211.839172:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746212.174545:0:10114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:56:51 (1788746211) === 00000100:00100000:0.0:1788746212.549953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.550036:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141433984 00000100:00100000:3.0:1788746212.550047:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141433984 00000100:00100000:3.0:1788746212.550104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 207 00000100:00100000:3.0:1788746212.550114:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:8113:x1875636141433984:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788746212.550145:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746212.550163:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f940a00/0xe59b64da5b3099d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b153 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.550190:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f940a00/0xe59b64da5b3099d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b153 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.550201:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f940a00/0xe59b64da5b3099d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b153 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.550210:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940a00, rc 0) 00000100:00100000:3.0:1788746212.550291:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141433984:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 178us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.550298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 207 00000100:00100000:3.0:1788746212.558579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746212.558695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434112 00000100:00100000:0.0:1788746212.558706:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434112 00000100:00100000:0.0:1788746212.558861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 208 00000100:00100000:0.0:1788746212.558881:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141434112:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788746212.559474:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141434112:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 603us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.559483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 208 00000100:00100000:0.0:1788746212.564034:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746212.564135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434240 00000100:00100000:1.0:1788746212.564144:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434240 00000100:00100000:1.0:1788746212.564207:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 209 00000100:00100000:1.0:1788746212.564230:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141434240:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746212.564465:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141434240:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 248us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746212.564473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 209 00000100:00100000:2.0:1788746212.572262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746212.572495:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434368 00000100:00100000:0.0:1788746212.572505:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434368 00000100:00100000:0.0:1788746212.572556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 210 00000100:00100000:0.0:1788746212.572566:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8117:x1875636141434368:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746212.572848:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8117:x1875636141434368:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 283us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.572856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 210 00000100:00100000:2.0:1788746212.589317:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.589436:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434496 00000100:00100000:3.0:1788746212.589445:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434496 00000100:00100000:3.0:1788746212.589500:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 211 00000100:00100000:3.0:1788746212.589510:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8117:x1875636141434496:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746212.589799:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8117:x1875636141434496:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 288us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.589807:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 211 00000100:00100000:2.0:1788746212.608374:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746212.608591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434624 00000100:00100000:1.0:1788746212.608601:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434624 00000100:00100000:1.0:1788746212.608656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 212 00000100:00100000:1.0:1788746212.608666:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+11:8113:x1875636141434624:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746212.608695:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746212.608714:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3099e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b17d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746212.608753:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3099e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b17d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746212.608764:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3099e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b17d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746212.608773:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478e00, rc 0) 00000100:00100000:1.0:1788746212.608837:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:8113:x1875636141434624:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 172us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746212.608845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 212 00000100:00100000:2.0:1788746212.612440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746212.612532:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434752 00000100:00100000:0.0:1788746212.612541:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434752 00000100:00100000:0.0:1788746212.612587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 213 00000100:00100000:0.0:1788746212.612597:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:8113:x1875636141434752:12345-192.168.206.24@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788746212.612621:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788746212.612645:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788746212.612649:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788746212.612653:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788746212.612660:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788746212.617342:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:8113:x1875636141434752:12345-192.168.206.24@tcp:256:mount.lustre.0 Request processed in 4725us (4887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.617358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 213 00000100:00100000:2.0:1788746212.622864:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.623031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141434880 00000100:00100000:3.0:1788746212.623041:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141434880 00000100:00100000:3.0:1788746212.623508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 214 00000100:00100000:3.0:1788746212.623520:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:8113:x1875636141434880:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788746212.623554:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746212.623572:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b184 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.623614:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.623625:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746212.623634:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746212.623696:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8113:x1875636141434880:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 178us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.623704:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 214 00000100:00100000:2.0:1788746212.632958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746212.633551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435008 00000100:00100000:0.0:1788746212.633562:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435008 00000100:00100000:0.0:1788746212.633625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 215 00000100:00100000:0.0:1788746212.633636:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8113:x1875636141435008:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788746212.633930:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8113:x1875636141435008:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 294us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.633937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 215 00000100:00100000:2.0:1788746212.637714:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746212.643076:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435136 00000100:00100000:1.0:1788746212.643090:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435136 00000100:00100000:1.0:1788746212.643148:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 216 00000100:00100000:1.0:1788746212.643157:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8113:x1875636141435136:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746212.644695:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8113:x1875636141435136:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 1531us (7362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746212.644708:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 216 00000100:00100000:2.0:1788746212.660731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.661603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435264 00000100:00100000:3.0:1788746212.661615:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435264 00000100:00100000:3.0:1788746212.661681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 217 00000100:00100000:3.0:1788746212.661690:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8122:x1875636141435264:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746212.661956:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8122:x1875636141435264:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 265us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.661966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 217 00000100:00100000:2.0:1788746212.679240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746212.679363:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435392 00000100:00100000:1.0:1788746212.679373:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435392 00000100:00100000:1.0:1788746212.679458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 218 00000100:00100000:1.0:1788746212.679469:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8122:x1875636141435392:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746212.679738:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:8122:x1875636141435392:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 270us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746212.679754:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 218 00000100:00100000:2.0:1788746212.686667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746212.686710:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.686878:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435904 00000100:00100000:3.0:1788746212.686887:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435904 00000100:00100000:3.0:1788746212.686940:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435520 00000100:00100000:3.0:1788746212.686943:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435520 00000100:00100000:3.0:1788746212.686966:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:3.0:1788746212.686976:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141435904:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746212.687081:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141435904:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.687088:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:3.0:1788746212.687109:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:3.0:1788746212.687114:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875636141435520:12345-192.168.206.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788746212.687138:0:5849:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from acc85ef4-d64f-49cc-8736-9bdf2adf468c@192.168.206.24@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:3.0:1788746212.687173:0:5849:0:(genops.c:1384:class_connect()) connect: client acc85ef4-d64f-49cc-8736-9bdf2adf468c, cookie 0xe59b64da5b3099ee 00000004:00100000:3.0:1788746212.687226:0:5849:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788746212.687570:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746212.687601:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2346:x1875636141435520:12345-192.168.206.24@tcp:38:mount.lustre.0 Request processed in 485us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.687608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:2.0:1788746212.697755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.698032:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435776 00000100:00100000:3.0:1788746212.698042:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435776 00000100:00100000:3.0:1788746212.698121:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746212.698131:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141435776:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788746212.698172:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788746212.698306:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141435776:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 176us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746212.698313:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746212.699058:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00080000:2.0:1788746212.699142:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746212.703701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746212.713021:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141435648 00000100:00100000:0.0:1788746212.713035:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141435648 00000100:00100000:0.0:1788746212.713095:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436032 00000100:00100000:0.0:1788746212.713099:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436032 00000100:00100000:0.0:1788746212.713163:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:0.0:1788746212.713174:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+7:0:x1875636141435648:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788746212.713223:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788746212.713302:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+7:0:x1875636141435648:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 129us (14246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.713309:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:0.0:1788746212.713549:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746212.713558:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141436032:12345-192.168.206.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788746212.713590:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141436032:12345-192.168.206.24@tcp:40:mount.lustre.0 Request processed in 34us (9898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746212.713596:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:3.0:1788746212.721452:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.721495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746212.721514:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746212.721651:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436416 00000100:00100000:1.0:1788746212.721661:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436416 00000100:00100000:1.0:1788746212.721715:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:1.0:1788746212.721739:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141436416:12345-192.168.206.24@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788746212.721825:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788746212.721918:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:8113:x1875636141436416:12345-192.168.206.24@tcp:33:mount.lustre.0 Request processed in 180us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746212.721926:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:2.0:1788746212.722489:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436160 00000100:00100000:2.0:1788746212.722496:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436160 00000100:00100000:2.0:1788746212.722529:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436288 00000100:00100000:2.0:1788746212.722532:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436288 00000100:00100000:2.0:1788746212.722550:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:2.0:1788746212.722557:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875636141436160:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788746212.722583:0:8456:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from acc85ef4-d64f-49cc-8736-9bdf2adf468c@192.168.206.24@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1788746212.722625:0:8456:0:(genops.c:1384:class_connect()) connect: client acc85ef4-d64f-49cc-8736-9bdf2adf468c, cookie 0xe59b64da5b3099f5 00002000:00100000:2.0:1788746212.722638:0:8456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli acc85ef4-d64f-49cc-8736-9bdf2adf468c/ffff9cd45f4f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788746212.722660:0:8456:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788746212.723017:0:8456:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788746212.723044:0:8456:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746212.723090:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2346:x1875636141436160:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 532us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746212.723097:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:2.0:1788746212.723118:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:2.0:1788746212.723123:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875636141436288:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788746212.723139:0:8456:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from acc85ef4-d64f-49cc-8736-9bdf2adf468c@192.168.206.24@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1788746212.723155:0:8456:0:(genops.c:1384:class_connect()) connect: client acc85ef4-d64f-49cc-8736-9bdf2adf468c, cookie 0xe59b64da5b3099fc 00002000:00100000:2.0:1788746212.723161:0:8456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli acc85ef4-d64f-49cc-8736-9bdf2adf468c/ffff9cd45f4f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788746212.723175:0:8456:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788746212.723318:0:8456:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788746212.724484:0:8456:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746212.724550:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2346:x1875636141436288:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 1422us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746212.724560:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00010000:00010000:1.0:1788746212.858603:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746213.831896:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163488384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746213.831962:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746213.832117:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488384 00000100:00100000:3.0:1788746213.832133:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488384 00000100:00100000:3.0:1788746213.832198:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788746213.832217:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163488384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746213.832238:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746213.832279:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163488384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746213.832286:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788746213.833036:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788746213.833073:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450081f80 x1875636163488384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746213.833109:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163488384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746213.882938:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746214.906509:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746215.398815:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000001:00100000:2.0:1788746215.445383:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000100:00100000:2.0:1788746215.867640:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746215.867662:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163488896:0@lo:400:kworker.0 00000100:00100000:0.0:1788746215.867662:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163488512:0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.867738:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163488640:0@lo:400:kworker.0 00000100:00100000:0.0:1788746215.868748:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746215.868805:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163489024:0@lo:400:kworker.0 00000100:00100000:0.0:1788746215.868943:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746215.873332:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489024 00000100:00100000:1.0:1788746215.873344:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489024 00000100:00100000:1.0:1788746215.873436:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788746215.873447:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163489024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746215.873539:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163489024:12345-0@lo:400:kworker.0 Request processed in 95us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746215.873547:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788746215.873817:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163489024:0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.874625:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746215.874669:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163489152:0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.874700:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746215.874733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488512 00000100:00100000:3.0:1788746215.874739:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488512 00000100:00100000:3.0:1788746215.874773:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788746215.874780:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163488512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.874822:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163488512:12345-0@lo:400:kworker.0 Request processed in 42us (6076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746215.874829:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1788746215.875535:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746215.878066:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488640 00000100:00100000:1.0:1788746215.878080:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488640 00000100:00100000:1.0:1788746215.878146:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788746215.878155:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163488640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746215.878277:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163488640:12345-0@lo:400:kworker.0 Request processed in 123us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746215.878293:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788746215.878447:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489152 00000100:00100000:1.0:1788746215.878453:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489152 00000100:00100000:1.0:1788746215.878493:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788746215.878499:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163489152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746215.878531:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163489152:12345-0@lo:400:kworker.0 Request processed in 33us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746215.878536:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788746215.878873:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746215.878909:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163488512:0@lo:400:kworker.0 00000100:00100000:1.0:1788746215.878956:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163488640:0@lo:400:kworker.0 00010000:00080000:1.0:1788746215.878971:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a7b80 x1875636163489152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746215.878982:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163489152:0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.883823:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746215.883863:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488896 00000100:00100000:0.0:1788746215.883873:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488896 00000100:00100000:3.0:1788746215.883874:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163488768:0@lo:400:kworker.0 00000100:00100000:3.0:1788746215.883912:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746215.883925:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746215.883934:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163488896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746215.883996:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163488896:12345-0@lo:400:kworker.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746215.884003:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788746215.884347:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4700 x1875636163488896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746215.884361:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163488896:0@lo:400:kworker.0 00000100:00080000:1.0:1788746215.890645:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746215.890668:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163488768 00000100:00100000:1.0:1788746215.890679:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163488768 00000100:00100000:1.0:1788746215.890744:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788746215.890754:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163488768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746215.890845:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163488768:12345-0@lo:400:kworker.0 Request processed in 92us (6931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746215.890852:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788746215.890871:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746215.890910:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163488768:0@lo:400:kworker.0 00010000:00010000:0.0:1788746215.932686:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746215.975493:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000100:00100000:1.0:1788746216.378747:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163489280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746216.378827:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746216.378978:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489280 00000100:00100000:3.0:1788746216.378987:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489280 00000100:00100000:3.0:1788746216.379039:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788746216.379050:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163489280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746216.379084:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746216.379132:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163489280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746216.379139:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788746216.379244:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001f100 x1875636163489280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746216.379261:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163489280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746216.955770:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746217.982467:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746218.007611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746218.007647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746218.007674:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746218.007709:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746218.007739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746218.007769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436544 00000100:00100000:2.0:1788746218.007778:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436544 00000100:00100000:2.0:1788746218.007824:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 220 00000100:00100000:2.0:1788746218.007835:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141436544:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746218.007895:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141436544:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746218.007902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 220 00000100:00100000:2.0:1788746218.007939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436672 00000100:00100000:2.0:1788746218.007943:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436672 00000100:00100000:2.0:1788746218.007977:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436800 00000100:00100000:2.0:1788746218.007980:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436800 00000100:00100000:2.0:1788746218.008002:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:2.0:1788746218.008009:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141436672:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746218.008041:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141436672:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 32us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746218.008053:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:2.0:1788746218.008068:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:2.0:1788746218.008073:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141436800:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746218.008099:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141436800:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746218.008105:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:2.0:1788746218.008124:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141436928 00000100:00100000:2.0:1788746218.008128:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141436928 00000100:00100000:2.0:1788746218.008152:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437056 00000100:00100000:2.0:1788746218.008156:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437056 00000100:00100000:2.0:1788746218.008176:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:2.0:1788746218.008196:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141436928:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746218.008221:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141436928:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 39us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746218.008227:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:2.0:1788746218.008240:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:2.0:1788746218.008246:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141437056:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746218.008268:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141437056:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746218.008275:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00080000:2.0:1788746218.008436:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746218.008440:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746218.008443:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788746218.274868:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788746218.939427:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163489408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746218.939520:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746218.939825:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489408 00000100:00100000:3.0:1788746218.939832:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489408 00000100:00100000:3.0:1788746218.939906:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788746218.939915:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163489408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746218.939945:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746218.939992:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163489408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746218.939999:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788746218.940379:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788746218.940428:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd48001e300 x1875636163489408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746218.940448:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163489408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788746219.002575:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746220.033682:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746220.987589:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163489792:0@lo:400:kworker.0 00000100:00100000:0.0:1788746220.987660:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746220.987747:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489792 00000100:00100000:0.0:1788746220.987755:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489792 00000100:00100000:0.0:1788746220.987808:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746220.987817:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746220.987886:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163489792:12345-0@lo:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746220.987892:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788746220.987929:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746220.987960:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163489792:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988116:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163489664:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988148:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746220.988183:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746220.988189:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163489536:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988217:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746220.988250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489664 00000100:00100000:3.0:1788746220.988254:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489664 00000100:00100000:3.0:1788746220.988297:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788746220.988305:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163489664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988349:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163489664:12345-0@lo:400:kworker.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746220.988368:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788746220.988391:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489536 00000100:00100000:3.0:1788746220.988395:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489536 00000100:00100000:3.0:1788746220.988445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788746220.988452:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163489536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988479:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163489536:12345-0@lo:400:kworker.0 Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746220.988486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788746220.988523:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163489536:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.988535:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163489664:0@lo:400:kworker.0 00000100:00100000:0.0:1788746220.988968:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163489920:0@lo:400:kworker.0 00000100:00100000:0.0:1788746220.990155:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746220.991655:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163489920 00000100:00100000:3.0:1788746220.991668:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163489920 00000100:00100000:3.0:1788746220.991751:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788746220.991763:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163489920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.991848:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163489920:12345-0@lo:400:kworker.0 Request processed in 88us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746220.991854:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788746220.991905:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a5500 x1875636163489920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746220.991920:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163489920:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.991951:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163490176:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.991987:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746220.992043:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746220.992050:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163490048:0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.992105:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746220.992137:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490176 00000100:00100000:3.0:1788746220.992141:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490176 00000100:00100000:3.0:1788746220.992182:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746220.992189:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163490176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.992226:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163490176:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746220.992232:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746220.992256:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490048 00000100:00100000:3.0:1788746220.992260:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490048 00000100:00100000:3.0:1788746220.992290:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788746220.992297:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163490048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746220.992327:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163490048:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746220.992333:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788746220.992600:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163490048:0@lo:400:kworker.0 00010000:00080000:3.0:1788746220.992613:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a5880 x1875636163490176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746220.992622:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163490176:0@lo:400:kworker.0 00000100:00080000:0.0:1788746220.992692:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788746220.992696:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746220.992698:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746221.050778:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746221.499639:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163490304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746221.499703:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746221.499864:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490304 00000100:00100000:3.0:1788746221.499873:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490304 00000100:00100000:3.0:1788746221.499926:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746221.499935:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163490304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746221.499970:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746221.500031:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163490304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746221.500038:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788746221.500118:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d291180 x1875636163490304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746221.500135:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163490304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746222.074704:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746223.098546:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746223.129562:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746223.129649:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746223.130249:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437312 00000100:00100000:1.0:1788746223.130259:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437312 00000100:00100000:1.0:1788746223.130324:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:1.0:1788746223.130336:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141437312:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746223.130424:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141437312:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 91us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746223.130432:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00080000:1.0:1788746223.130453:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746223.137309:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437184 00000100:00100000:0.0:1788746223.137323:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437184 00000100:00100000:0.0:1788746223.137473:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 222 00000100:00100000:0.0:1788746223.137485:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141437184:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746223.137558:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141437184:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 75us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746223.137565:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 222 00000100:00100000:2.0:1788746223.146642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746223.146689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746223.146774:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437568 00000100:00100000:3.0:1788746223.146783:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437568 00000100:00100000:3.0:1788746223.146854:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:3.0:1788746223.146864:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437568:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746223.146932:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437568:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746223.146940:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00080000:1.0:1788746223.147069:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746223.147421:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437440 00000100:00100000:0.0:1788746223.147426:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437440 00000100:00100000:0.0:1788746223.147478:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:0.0:1788746223.147487:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437440:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746223.147525:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437440:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 40us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746223.147546:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00080000:1.0:1788746223.147604:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746223.162849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746223.162980:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437696 00000100:00100000:3.0:1788746223.162990:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437696 00000100:00100000:3.0:1788746223.163050:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:3.0:1788746223.163060:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd443772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437696:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:2.0:1788746223.163064:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746223.163142:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd443772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141437696:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746223.163149:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:1.0:1788746224.059678:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163490432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746224.059759:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746224.060672:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490432 00000100:00100000:3.0:1788746224.060684:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490432 00000100:00100000:3.0:1788746224.060787:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788746224.060798:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163490432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746224.060850:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746224.060926:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163490432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746224.060933:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788746224.061163:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d291f80 x1875636163490432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746224.061184:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163490432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788746224.061331:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788746224.122671:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746225.146672:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746226.111785:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163490816:0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.111857:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746226.111909:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746226.111914:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163490944:0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.111956:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746226.112003:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490816 00000100:00100000:1.0:1788746226.112010:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490816 00000100:00100000:1.0:1788746226.112060:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746226.112070:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.112120:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163490816:12345-0@lo:400:kworker.0 Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746226.112127:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746226.112164:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490944 00000100:00100000:1.0:1788746226.112168:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490944 00000100:00100000:1.0:1788746226.112393:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746226.112448:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.112485:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163490944:12345-0@lo:400:kworker.0 Request processed in 39us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746226.112492:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788746226.112508:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746226.112513:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788746226.112544:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f603480 x1875636163490944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746226.112559:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163490944:0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.112570:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163490816:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.112710:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163490560:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.112748:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746226.112785:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163491072:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.112807:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746226.112839:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788746226.112845:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163490688:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.112867:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746226.112885:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.112905:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746226.112928:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491072 00000100:00100000:3.0:1788746226.112932:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491072 00000100:00100000:3.0:1788746226.112956:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490688 00000100:00100000:3.0:1788746226.112959:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490688 00000100:00100000:3.0:1788746226.112989:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746226.112995:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163491072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.113032:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163491072:12345-0@lo:400:kworker.0 Request processed in 36us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746226.113037:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746226.113050:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746226.113055:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.113081:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163490688:12345-0@lo:400:kworker.0 Request processed in 26us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746226.113087:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746226.113105:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491200 00000100:00100000:3.0:1788746226.113108:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491200 00000100:00100000:3.0:1788746226.113132:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788746226.113151:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163491200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.113379:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163491200:12345-0@lo:400:kworker.0 Request processed in 229us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746226.113386:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788746226.113460:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163490688:0@lo:400:kworker.0 00010000:00080000:3.0:1788746226.113471:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f4e3480 x1875636163491200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746226.113481:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788746226.113490:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163491072:0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.113681:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163490560 00000100:00100000:1.0:1788746226.113686:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163490560 00000100:00100000:1.0:1788746226.113710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788746226.113716:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746226.113760:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163490560:12345-0@lo:400:kworker.0 Request processed in 44us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746226.113772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1788746226.113798:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746226.113801:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746226.113897:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163490560:0@lo:400:kworker.0 00010000:00010000:2.0:1788746226.173393:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746226.618696:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163491328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746226.618766:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746226.618843:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491328 00000100:00100000:3.0:1788746226.618851:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491328 00000100:00100000:3.0:1788746226.618896:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788746226.618905:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163491328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746226.618951:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746226.618997:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163491328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746226.619005:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788746226.619044:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d290000 x1875636163491328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746226.619062:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163491328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788746227.194595:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746228.221293:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746228.246720:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746228.246772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746228.246802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746228.246842:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746228.246877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746228.246909:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438208 00000100:00100000:1.0:1788746228.246909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437952 00000100:00100000:2.0:1788746228.246921:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438208 00000100:00100000:1.0:1788746228.246921:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437952 00000100:00100000:3.0:1788746228.246991:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438080 00000100:00100000:3.0:1788746228.246996:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438080 00000100:00100000:1.0:1788746228.246999:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 74 00000100:00100000:1.0:1788746228.247011:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141437952:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746228.247065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141437824 00000100:00100000:0.0:1788746228.247069:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141437824 00000100:00100000:0.0:1788746228.247110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 224 00000100:00100000:1.0:1788746228.247116:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141437952:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 107us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746228.247117:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141437824:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746228.247133:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 74 00000100:00100000:1.0:1788746228.247160:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438336 00000100:00100000:1.0:1788746228.247164:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438336 00000100:00100000:0.0:1788746228.247165:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141437824:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746228.247171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 224 00000100:00080000:0.0:1788746228.248830:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746228.248843:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746228.248848:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746228.249553:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:2.0:1788746228.249573:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141438208:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746228.249656:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141438208:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 93us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746228.249665:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:3.0:1788746228.249775:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:3.0:1788746228.249783:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141438080:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746228.249814:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141438080:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 32us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746228.249820:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:1.0:1788746228.253894:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:1.0:1788746228.254625:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141438336:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746228.256644:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141438336:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 2025us (9752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746228.256661:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:2.0:1788746229.179798:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746229.179826:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746229.179937:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746229.180032:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491456 00000100:00100000:2.0:1788746229.180042:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491456 00000100:00100000:2.0:1788746229.180108:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788746229.180130:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163491456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746229.180176:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746229.180229:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746229.180236:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788746229.180280:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788746229.180316:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f5d9c00 x1875636163491456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746229.180336:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163491456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746229.255383:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746230.270036:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746231.226849:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163491840:0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.226849:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163491712:0@lo:400:kworker.0 00000100:00100000:2.0:1788746231.227011:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746231.227091:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491840 00000100:00100000:0.0:1788746231.227101:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491840 00000100:00100000:3.0:1788746231.227133:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163491584:0@lo:400:kworker.0 00000100:00100000:0.0:1788746231.227196:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788746231.227208:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.230571:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746231.230696:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163492224:0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.230770:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746231.230840:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163491968:0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.230867:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746231.230928:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492224 00000100:00100000:1.0:1788746231.230938:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492224 00000100:00100000:1.0:1788746231.231002:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491968 00000100:00100000:1.0:1788746231.231005:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491968 00000100:00100000:1.0:1788746231.231032:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788746231.231044:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.231119:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163492224:12345-0@lo:400:kworker.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746231.231126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788746231.231148:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788746231.231154:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746231.231186:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163491968:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746231.231192:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788746231.231258:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a7100 x1875636163491968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746231.231274:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163491968:0@lo:400:kworker.0 00010000:00080000:1.0:1788746231.231306:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a5880 x1875636163492224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746231.231314:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163492224:0@lo:400:kworker.0 00000100:00100000:2.0:1788746231.232075:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491712 00000100:00100000:2.0:1788746231.232088:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491712 00000100:00100000:2.0:1788746231.232212:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788746231.232221:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163491712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746231.232287:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163491712:12345-0@lo:400:kworker.0 Request processed in 67us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746231.232295:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788746231.236098:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163491712:0@lo:400:kworker.0 00000100:00100000:3.0:1788746231.236267:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746231.236304:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163491840:12345-0@lo:400:kworker.0 Request processed in 9094us (9288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746231.236322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163491584 00000100:00100000:3.0:1788746231.236331:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163491584 00000100:00100000:3.0:1788746231.236427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788746231.236439:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163491584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746231.236506:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163491584:12345-0@lo:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746231.236514:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788746231.236580:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163491584:0@lo:400:kworker.0 00000100:00100000:3.0:1788746231.236595:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163492096:0@lo:400:kworker.0 00000100:00100000:3.0:1788746231.236632:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746231.236662:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492096 00000100:00100000:0.0:1788746231.236667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788746231.236668:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492096 00000100:00080000:0.0:1788746231.236700:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746231.236708:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746231.236712:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746231.236717:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788746231.236726:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746231.236757:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163491840:0@lo:400:kworker.0 00000100:00100000:3.0:1788746231.236768:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163492096:12345-0@lo:400:kworker.0 Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746231.236776:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788746231.236809:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163492096:0@lo:400:kworker.0 00010000:00010000:3.0:1788746231.290621:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746231.743085:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163492352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746231.743166:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746231.743274:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492352 00000100:00100000:0.0:1788746231.743291:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492352 00000100:00100000:0.0:1788746231.743342:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788746231.743352:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163492352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746231.743384:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746231.743461:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163492352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746231.743468:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788746231.743752:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4e00 x1875636163492352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746231.743796:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163492352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788746232.314866:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746233.343319:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746233.372943:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746233.372985:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746233.373028:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746233.373064:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746233.373134:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746233.373165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438720 00000100:00100000:2.0:1788746233.373174:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438720 00000100:00100000:2.0:1788746233.373222:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438592 00000100:00100000:2.0:1788746233.373225:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438592 00000100:00100000:2.0:1788746233.373249:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:2.0:1788746233.373259:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2350:x1875636141438720:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746233.373333:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2350:x1875636141438720:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746233.373341:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:2.0:1788746233.373364:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:2.0:1788746233.373371:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141438592:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746233.373429:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141438592:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746233.373435:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00080000:2.0:1788746233.373458:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746233.373868:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438848 00000100:00100000:3.0:1788746233.373874:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438848 00000100:00100000:3.0:1788746233.373919:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438976 00000100:00100000:3.0:1788746233.373922:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438976 00000100:00100000:3.0:1788746233.373944:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:3.0:1788746233.373951:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2346:x1875636141438848:12345-192.168.206.24@tcp:9:kworker.0 00000020:00000080:3.0:1788746233.373971:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3099f5 00000100:00080000:3.0:1788746233.373980:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746233.374015:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788746233.374334:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+2:2346:x1875636141438848:12345-192.168.206.24@tcp:9:kworker.0 Request processed in 382us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746233.374341:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:3.0:1788746233.374355:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:3.0:1788746233.374363:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2346:x1875636141438976:12345-192.168.206.24@tcp:9:kworker.0 00000020:00000080:3.0:1788746233.374375:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3099fc 00000100:00080000:3.0:1788746233.374380:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746233.374431:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788746233.374760:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+2:2346:x1875636141438976:12345-192.168.206.24@tcp:9:kworker.0 Request processed in 396us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746233.374768:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00010000:00010000:3.0:1788746233.374804:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746233.375342:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746233.375485:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141438464 00000100:00100000:0.0:1788746233.375494:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141438464 00000100:00100000:0.0:1788746233.375538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 226 00000100:00100000:0.0:1788746233.375548:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141438464:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746233.375595:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141438464:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 48us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746233.375602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 226 00000100:00080000:2.0:1788746233.376006:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746233.376012:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746234.298563:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163492480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746234.298636:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746234.299450:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492480 00000100:00100000:0.0:1788746234.299459:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492480 00000100:00100000:0.0:1788746234.299528:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788746234.299540:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163492480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746234.299584:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788746234.299677:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746234.300383:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163492480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 843us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746234.300393:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788746234.304813:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f5d8380 x1875636163492480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746234.304840:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163492480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788746234.362592:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746235.387732:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788746235.893523:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000020:00000080:3.0:1788746235.893532:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cd45f4f4000/acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000020:00000080:0.0:1788746235.893669:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f4f4000/acc85ef4-d64f-49cc-8736-9bdf2adf468c for lustre-OST0001 00000020:00000080:0.0:1788746235.893718:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45f4f2000 for lustre-OST0001 00000100:00100000:0.0:1788746236.346842:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163492864:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.346917:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.346988:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746236.346994:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163492992:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347019:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.347054:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492864 00000100:00100000:0.0:1788746236.347060:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492864 00000100:00100000:0.0:1788746236.347123:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746236.347133:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163492864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347180:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163492864:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.347187:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746236.347208:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492992 00000100:00100000:0.0:1788746236.347212:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492992 00000100:00100000:0.0:1788746236.347582:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788746236.347593:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347627:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163492992:12345-0@lo:400:kworker.0 Request processed in 37us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.347633:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788746236.347652:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746236.347656:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788746236.347705:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4000 x1875636163492992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746236.347718:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163492992:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347728:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163492864:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163492736:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.347791:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.348092:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163493248:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348119:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.348155:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788746236.348163:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163492608:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348193:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.348213:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163493120:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348231:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.348437:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492736 00000100:00100000:0.0:1788746236.348443:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492736 00000100:00100000:0.0:1788746236.348470:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493120 00000100:00100000:0.0:1788746236.348473:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493120 00000100:00100000:0.0:1788746236.348498:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788746236.348505:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163492736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348542:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163492736:12345-0@lo:400:kworker.0 Request processed in 38us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.348559:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788746236.348574:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788746236.348580:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163493120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348606:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163493120:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.348611:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788746236.348628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163492608 00000100:00100000:0.0:1788746236.348631:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163492608 00000100:00100000:0.0:1788746236.348651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788746236.348656:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163492608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348683:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163492608:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.348703:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1788746236.348735:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746236.348755:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163492608:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348766:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163493120:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.348774:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163492736:0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.349681:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493248 00000100:00100000:0.0:1788746236.349688:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493248 00000100:00100000:0.0:1788746236.349731:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788746236.349932:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746236.350444:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163493248:12345-0@lo:400:kworker.0 Request processed in 706us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.350452:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788746236.350477:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788746236.350500:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4700 x1875636163493248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746236.350513:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163493248:0@lo:400:kworker.0 00010000:00010000:3.0:1788746236.410552:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788746236.464874:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000020:00000080:0.0:1788746236.464882:0:6706:0:(genops.c:885:class_export_put()) final put ffff9cd45f4f2800/acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000020:00000080:0.0:1788746236.464906:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f4f2800/acc85ef4-d64f-49cc-8736-9bdf2adf468c for lustre-OST0000 00000020:00000080:0.0:1788746236.464956:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45f4f0000 for lustre-OST0000 00000100:00100000:2.0:1788746236.858614:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746236.860695:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746236.860849:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746236.860956:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493376 00000100:00100000:0.0:1788746236.860965:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493376 00000100:00100000:0.0:1788746236.861023:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788746236.861033:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163493376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746236.861102:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746236.861162:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163493376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746236.861170:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788746236.861538:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd4802a4700 x1875636163493376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746236.861567:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163493376:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788746237.171311:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788746237.435969:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746238.458915:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746238.493533:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746238.493566:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746238.493692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439104 00000100:00100000:0.0:1788746238.493703:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439104 00000100:00100000:0.0:1788746238.493761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 228 00000100:00100000:0.0:1788746238.493771:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141439104:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746238.493842:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141439104:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746238.493850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 228 00000100:00100000:2.0:1788746238.495375:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746238.499667:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439360 00000100:00100000:1.0:1788746238.499683:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439360 00000100:00100000:0.0:1788746238.499728:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439232 00000100:00100000:0.0:1788746238.499735:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439232 00000100:00100000:0.0:1788746238.499816:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:0.0:1788746238.499826:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141439232:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746238.499906:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141439232:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 82us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746238.499913:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:0.0:1788746238.499950:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00100000:0.0:1788746238.499956:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141439360:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746238.499978:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141439360:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 22us (6411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746238.499983:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00080000:2.0:1788746238.500312:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746239.419673:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746239.419695:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163493504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746239.419761:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746239.419861:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493504 00000100:00100000:2.0:1788746239.419869:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493504 00000100:00100000:2.0:1788746239.419934:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788746239.419944:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163493504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746239.419976:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746239.420024:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163493504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746239.420031:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788746239.420084:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f5d9f80 x1875636163493504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746239.420102:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163493504:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788746239.420109:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746239.487154:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746240.512873:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788746240.638865:0:11159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde85442e0 20000000:00000080:0.0:1788746240.638901:0:11159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd477405800 uarg=0000000000000000 20000000:01000000:0.0:1788746240.638936:0:11159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788746240.638942:0:11159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788746240.638946:0:11159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788746240.639979:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788746240.640256:0:11159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788746240.648284:0:11159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788746240.648315:0:11159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648336:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648344:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648350:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648356:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648362:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648368:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648581:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648598:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 12 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.648622:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493632:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746240.648735:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648743:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 18 pid: 5843 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.648753:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493760:0@lo:104: 00000100:00100000:0.0:1788746240.648788:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788746240.648828:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648836:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 18 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.648843:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493888:0@lo:104: 00000100:00100000:0.0:1788746240.648863:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788746240.648909:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.648918:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.648925:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163494016:0@lo:104: 00000100:00100000:0.0:1788746240.648947:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746240.649005:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493760 00000100:00100000:2.0:1788746240.649012:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493760 00000100:00100000:2.0:1788746240.649069:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163493888 00000100:00100000:2.0:1788746240.649072:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163493888 00000100:00100000:2.0:1788746240.649083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494016 00000100:00100000:2.0:1788746240.649085:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494016 00000100:00100000:2.0:1788746240.649106:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788746240.649117:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+5:11159:x1875636163493760:12345-0@lo:104: 00010000:00010000:2.0:1788746240.649130:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.649192:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746240.649210:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.649219:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477454000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163494144:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746240.653448:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788746240.653464:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+5:11159:x1875636163493760:12345-0@lo:104: Request processed in 4345us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746240.653476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788746240.653517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746240.653527:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:11159:x1875636163493888:12345-0@lo:104: 00010000:00010000:2.0:1788746240.653557:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.653608:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788746240.653614:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:11159:x1875636163493888:12345-0@lo:104: Request processed in 91us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746240.653619:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746240.653633:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788746240.653640:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:11159:x1875636163494016:12345-0@lo:104: 00010000:00010000:2.0:1788746240.653648:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.654297:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788746240.654306:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:11159:x1875636163494016:12345-0@lo:104: Request processed in 666us (5357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746240.654313:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788746240.654343:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788746240.654350:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.654765:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478200 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746240.654772:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.654782:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746240.654790:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746240.654809:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788746240.654850:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.654857:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788746240.655022:0:11159:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4457836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746240.655071:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493760:0@lo:104: 00000100:00100000:0.0:1788746240.655082:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493888:0@lo:104: 00000100:00100000:0.0:1788746240.655089:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163494016:0@lo:104: 00010000:00010000:2.0:1788746240.655785:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.655795:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441478200/0xe59b64da5b3099cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.655812:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746240.655816:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.655822:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746240.655825:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.655832:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746240.655839:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746240.655844:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788746240.656796:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.656807:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746240.656833:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.656839:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441478000/0xe59b64da5b3099bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.656855:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746240.656858:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.656864:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09a400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746240.656867:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.656875:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.657382:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788746240.659204:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746240.659212:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788746240.659249:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.659256:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746240.659294:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.659301:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09a400/0xe59b64da5b3099af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b3099b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.659320:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746240.659333:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746240.659335:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746240.659356:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163494400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788746240.659443:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746240.659485:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788746240.659491:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163494272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788746240.659512:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746240.659537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494400 00000100:00100000:2.0:1788746240.659543:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494400 00010000:00010000:2.0:1788746240.659568:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 19 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746240.659591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494272 00000100:00100000:2.0:1788746240.659594:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494272 00010000:00010000:2.0:1788746240.659603:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 20 pid: 5843 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746240.659619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746240.659625:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3315:x1875636163494400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746240.659636:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746240.659641:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.659650:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746240.659663:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f940000/0xe59b64da5b3099c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3099bd expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746240.660159:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746240.660176:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746240.660187:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163494528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746240.660214:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746240.660242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439488 00000100:00100000:3.0:1788746240.660246:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439488 00010000:00010000:3.0:1788746240.660266:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 13 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746240.660280:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494528 00000100:00100000:3.0:1788746240.660283:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494528 00010000:00010000:3.0:1788746240.660293:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746240.660306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746240.660312:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3315:x1875636163494272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746240.660320:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746240.660324:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 20 pid: 5843 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660331:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 20 pid: 5843 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660356:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f941400/0xe59b64da5b3099d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3099cb expref: 20 pid: 5843 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660367:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746240.660431:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163494272:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746240.660438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746240.660461:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:3.0:1788746240.660469:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141439488:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746240.660477:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746240.660482:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 13 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660492:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 13 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660502:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746240.660536:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141439488:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 68us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746240.660542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:3.0:1788746240.660556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788746240.660562:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3317:x1875636163494528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746240.660572:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746240.660577:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660587:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660604:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479000/0xe59b64da5b3099b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b3099af expref: 18 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746240.660613:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746240.660643:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3317:x1875636163494528:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746240.660649:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788746240.661193:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746240.661257:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f940e00/0xe59b64da5b3099e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b184 expref: 12 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746240.661269:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163493632:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746240.661670:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746240.661818:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3315:x1875636163494400:12345-0@lo:103:ldlm_bl.0 Request processed in 2191us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746240.661828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788746240.662829:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163494272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746240.662839:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163494400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746240.663275:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477454000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875636163494144:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746240.663304:0:11159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746240.665702:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746240.665764:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163494528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746240.665837:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439616 00000100:00100000:1.0:1788746240.665844:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439616 00010000:00010000:1.0:1788746240.665889:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746240.665925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:1.0:1788746240.665935:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:2350:x1875636141439616:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746240.665963:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746240.665970:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.665981:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.665998:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b400/0xe59b64da5b3099a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b14c expref: 12 pid: 5842 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666014:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666031:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666048:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666066:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666072:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666079:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666085:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09be00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746240.666089:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666107:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666123:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666133:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746240.666191:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2350:x1875636141439616:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 256us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746240.666199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 29 00010000:00010000:1.0:1788746240.666239:0:11159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666246:0:11159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746240.666252:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09be00/0xe59b64da5b309a03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746241.472734:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163494656:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.472795:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.472850:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163495168:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.472876:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.472905:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746241.472911:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163495040:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473030:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.473077:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163494784:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473223:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.473248:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746241.473254:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163494912:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473279:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.473310:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494656 00000100:00100000:3.0:1788746241.473318:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494656 00000100:00100000:3.0:1788746241.473357:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495040 00000100:00100000:3.0:1788746241.473360:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495040 00000100:00100000:3.0:1788746241.473379:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494784 00000100:00100000:3.0:1788746241.473393:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494784 00000100:00100000:3.0:1788746241.473443:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788746241.473452:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163494656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473503:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163494656:12345-0@lo:400:kworker.0 Request processed in 52us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.473510:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788746241.473528:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788746241.473535:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163495040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473563:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163495040:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.473569:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788746241.473581:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788746241.473587:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163494784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473619:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163494784:12345-0@lo:400:kworker.0 Request processed in 33us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.473625:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788746241.473642:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495168 00000100:00100000:3.0:1788746241.473646:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495168 00000100:00100000:3.0:1788746241.473672:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163494912 00000100:00100000:3.0:1788746241.473676:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163494912 00000100:00100000:3.0:1788746241.473698:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788746241.473705:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163495168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473734:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163495168:12345-0@lo:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.473740:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788746241.473751:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788746241.473756:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163494912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473791:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163494912:12345-0@lo:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.473796:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788746241.473824:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746241.473828:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746241.473831:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788746241.473861:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d292d80 x1875636163494912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746241.473873:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163494912:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473886:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163494784:0@lo:400:kworker.0 00000100:00100000:3.0:1788746241.473920:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163495040:0@lo:400:kworker.0 00000100:00100000:2.0:1788746241.479297:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163494656:0@lo:400:kworker.0 00010000:00080000:2.0:1788746241.479317:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d293100 x1875636163495168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746241.479328:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163495168:0@lo:400:kworker.0 00010000:00010000:2.0:1788746241.533371:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788746241.787083:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746241.787091:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd47ebce000 from 7 10000000:01000000:0.0:1788746241.787096:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746241.787149:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.787161:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.787172:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746241.787208:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.787285:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746241.787354:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4457836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746241.787493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495296 00000100:00100000:2.0:1788746241.787501:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495296 00000100:00100000:2.0:1788746241.787550:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788746241.787570:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163495296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746241.787586:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746241.787600:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309a0a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.787623:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.787634:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.787643:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:2.0:1788746241.787683:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746241.787689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788746241.788529:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746241.788551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.788644:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746241.788730:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.788774:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.789346:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746241.789589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495424 00000100:00100000:0.0:1788746241.789597:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495424 00000100:00100000:0.0:1788746241.789677:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788746241.789686:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.789947:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746241.789954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788746241.790026:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.790079:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.790120:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746241.796697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495552 00000100:00100000:2.0:1788746241.796725:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495552 00000100:00100000:1.0:1788746241.796736:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746241.796766:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788746241.796775:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746241.797026:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (6904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746241.797035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788746241.798722:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788746241.799628:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788746241.799829:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788746241.799852:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746241.799863:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.799875:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746241.799885:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746241.799888:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448dea800 from 7 10000000:01000000:1.0:1788746241.799890:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746241.799923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.799931:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.799940:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746241.799961:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.800020:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.800079:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746241.800177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495680 00000100:00100000:2.0:1788746241.800183:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495680 00000100:00100000:2.0:1788746241.800228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788746241.800237:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163495680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746241.800258:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746241.800270:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309a18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.800291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.800301:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.800316:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45400, rc 0) 00000100:00100000:2.0:1788746241.800428:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163495680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746241.800435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788746241.808009:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746241.808040:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.808064:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746241.808148:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.808217:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.808269:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746241.808331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495808 00000100:00100000:0.0:1788746241.808339:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495808 00000100:00100000:0.0:1788746241.808389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788746241.808419:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163495808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.808684:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163495808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746241.808692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788746241.808925:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.808961:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.809003:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.809034:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746241.809099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163495936 00000100:00100000:3.0:1788746241.809104:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163495936 00000100:00100000:3.0:1788746241.809138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788746241.809145:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163495936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746241.809311:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163495936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.809318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788746241.809549:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163495936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746241.811253:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788746241.811543:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788746241.811565:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746241.811577:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.811589:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746241.811601:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746241.811614:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448caf000 from 7 10000000:01000000:0.0:1788746241.811617:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746241.811653:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.811662:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.811672:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746241.811695:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.811758:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746241.811800:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746241.811849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496064 00000100:00100000:2.0:1788746241.811857:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496064 00000100:00100000:2.0:1788746241.811906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788746241.811916:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163496064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746241.811935:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746241.811947:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309a26 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.811969:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.811979:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746241.811988:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44200, rc 0) 00000100:00100000:2.0:1788746241.812023:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163496064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746241.812030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788746241.813594:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746241.813619:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746241.813630:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746241.813705:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.813756:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.813811:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746241.813970:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496192 00000100:00100000:0.0:1788746241.813977:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496192 00000100:00100000:0.0:1788746241.814022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788746241.814031:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163496192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.814292:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163496192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746241.814300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788746241.820739:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.820814:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746241.820897:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746241.820940:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746241.820988:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496320 00000100:00100000:0.0:1788746241.820995:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496320 00000100:00100000:0.0:1788746241.821041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788746241.821062:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163496320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746241.821275:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163496320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746241.821283:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788746241.821525:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163496320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746241.822370:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788746241.822649:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788746241.822676:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746241.822686:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746241.822696:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746241.978806:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746241.978829:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163496448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746241.978893:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746241.978952:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496448 00000100:00100000:3.0:1788746241.978959:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496448 00000100:00100000:3.0:1788746241.979001:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746241.979010:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163496448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746241.979085:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746241.979129:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163496448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746241.979137:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788746241.979176:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd44626aa00 x1875636163496448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746241.979194:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163496448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746242.326385:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746242.326541:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439744 00000100:00100000:0.0:1788746242.326551:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439744 00000100:00100000:0.0:1788746242.326607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 238 00000100:00100000:0.0:1788746242.326618:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:5590:x1875636141439744:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746242.326636:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746242.326657:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746242.326684:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746242.326694:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746242.326702:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b800, rc 0) 00000100:00100000:0.0:1788746242.326762:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141439744:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 145us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746242.326770:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 238 00000100:00100000:0.0:1788746242.331915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746242.332055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141439872 00000100:00100000:3.0:1788746242.332065:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141439872 00000100:00100000:3.0:1788746242.332117:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 239 00000100:00100000:3.0:1788746242.332128:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141439872:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746242.332444:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141439872:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 317us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746242.332452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 239 00000100:00100000:0.0:1788746242.351082:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746242.351466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440000 00000100:00100000:3.0:1788746242.351476:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440000 00000100:00100000:3.0:1788746242.351522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 240 00000100:00100000:3.0:1788746242.351532:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141440000:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746242.351755:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141440000:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 223us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746242.351764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 240 00000100:00100000:1.0:1788746242.379738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746242.380653:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440128 00000100:00100000:2.0:1788746242.380666:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440128 00000100:00100000:2.0:1788746242.380729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 241 00000100:00100000:2.0:1788746242.380740:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141440128:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746242.380755:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746242.380773:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1b5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746242.380800:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746242.380812:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746242.380822:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45000, rc 0) 00000100:00100000:2.0:1788746242.380893:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141440128:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746242.380900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 241 00000100:00100000:2.0:1788746242.394711:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746242.410799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440256 00000100:00100000:0.0:1788746242.410818:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440256 00000100:00100000:2.0:1788746242.411909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 242 00000100:00100000:2.0:1788746242.411924:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141440256:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746242.412254:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141440256:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 332us (17549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746242.412264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 242 00000100:00100000:1.0:1788746242.415053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746242.415133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440384 00000100:00100000:0.0:1788746242.415142:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440384 00000100:00100000:0.0:1788746242.415205:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 243 00000100:00100000:0.0:1788746242.415215:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141440384:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746242.415445:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141440384:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 230us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746242.415454:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 243 00010000:00010000:3.0:1788746242.559146:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746243.583876:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746243.609828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746243.609888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746243.609915:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746243.609948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440512 00000100:00100000:0.0:1788746243.609957:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440512 00000100:00100000:0.0:1788746243.610003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 244 00000100:00100000:0.0:1788746243.610024:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141440512:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746243.610101:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141440512:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746243.610107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 244 00000100:00100000:0.0:1788746243.610141:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440640 00000100:00100000:0.0:1788746243.610144:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440640 00000100:00100000:0.0:1788746243.610190:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440768 00000100:00100000:0.0:1788746243.610193:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440768 00000100:00100000:0.0:1788746243.610213:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 89 00000100:00100000:0.0:1788746243.610220:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141440640:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746243.610742:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:1.0:1788746243.610755:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141440768:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746243.610789:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141440768:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746243.610795:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:0.0:1788746243.610957:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141440640:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 736us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746243.610964:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 89 00000100:00080000:0.0:1788746243.611130:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746244.541114:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746244.541136:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163496576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746244.541213:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746244.541283:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496576 00000100:00100000:2.0:1788746244.541290:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496576 00000100:00100000:2.0:1788746244.541343:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746244.541353:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163496576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746244.541383:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746244.541444:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163496576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00080000:0.0:1788746244.541594:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746244.541701:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788746244.541749:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f528000 x1875636163496576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746244.541767:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163496576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788746244.603544:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746245.630593:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788746245.705114:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788746246.586592:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163496704:0@lo:400:kworker.0 00000100:00100000:3.0:1788746246.586680:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746246.586684:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.586716:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746246.586730:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163497216:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.586735:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746246.586740:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163497088:0@lo:400:kworker.0 00000100:00100000:3.0:1788746246.586750:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746246.586759:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746246.586768:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788746246.586773:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163496832:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.586789:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496960 00000100:00100000:0.0:1788746246.586796:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496960 00000100:00100000:3.0:1788746246.586808:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746246.586825:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163497344:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.586842:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497216 00000100:00100000:0.0:1788746246.586845:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497216 00000100:00100000:0.0:1788746246.586858:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496832 00000100:00100000:3.0:1788746246.586861:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746246.586861:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496832 00000100:00100000:0.0:1788746246.586876:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788746246.586884:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497088 00000100:00100000:0.0:1788746246.586884:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163496960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746246.586886:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497088 00000100:00100000:3.0:1788746246.586910:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497344 00000100:00100000:3.0:1788746246.586913:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497344 00000100:00100000:0.0:1788746246.586930:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163496960:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746246.586931:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746246.586937:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163497088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.586937:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788746246.586952:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788746246.586957:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163497216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746246.586965:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163497088:12345-0@lo:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746246.586971:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746246.586983:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746246.586983:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163497216:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746246.586988:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788746246.586998:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788746246.587001:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163497344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.587003:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163496832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746246.587038:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163497344:12345-0@lo:400:kworker.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746246.587038:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163496832:12345-0@lo:400:kworker.0 Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746246.587044:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746246.587049:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788746246.587062:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746246.587066:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746246.587069:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746246.587474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163496704 00000100:00100000:2.0:1788746246.587480:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163496704 00010000:00080000:0.0:1788746246.590706:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd477454380 x1875636163497088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746246.590724:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163497088:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.590737:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.590784:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163496832:0@lo:400:kworker.0 00010000:00080000:0.0:1788746246.590797:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd477456680 x1875636163497344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746246.590806:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163497344:0@lo:400:kworker.0 00000100:00100000:0.0:1788746246.590817:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163497216:0@lo:400:kworker.0 00000100:00100000:2.0:1788746246.602034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788746246.602060:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163496704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746246.602163:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163496704:12345-0@lo:400:kworker.0 Request processed in 116us (15482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746246.602171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788746246.602369:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163496704:0@lo:400:kworker.0 00010000:00010000:3.0:1788746246.650585:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746247.098632:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746247.098656:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163497472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746247.098730:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746247.099589:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497472 00000100:00100000:2.0:1788746247.099600:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497472 00000100:00100000:2.0:1788746247.099661:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788746247.099672:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163497472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746247.099707:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746247.099763:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163497472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746247.099770:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788746247.099925:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd44626b480 x1875636163497472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746247.099944:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd44626b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163497472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746247.675062:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746248.698634:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746248.738802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746248.738906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141440896 00000100:00100000:0.0:1788746248.738916:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141440896 00000100:00100000:0.0:1788746248.738973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 246 00000100:00100000:0.0:1788746248.738991:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141440896:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746248.739069:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141440896:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746248.739077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 246 00000100:00100000:1.0:1788746248.742611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746248.742663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746248.742767:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441024 00000100:00100000:2.0:1788746248.742777:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441024 00000100:00100000:2.0:1788746248.742854:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441152 00000100:00100000:2.0:1788746248.742858:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441152 00000100:00100000:2.0:1788746248.742884:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:2.0:1788746248.742893:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141441024:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746248.742966:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141441024:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 74us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746248.742973:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:2.0:1788746248.743016:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 95 00000100:00100000:2.0:1788746248.743028:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141441152:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746248.743055:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141441152:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746248.743061:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 95 00000100:00080000:1.0:1788746248.743715:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746249.659253:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746249.659377:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163497600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746249.659664:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746249.659726:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497600 00000100:00100000:2.0:1788746249.659734:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497600 00000100:00100000:2.0:1788746249.659786:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788746249.659795:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163497600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746249.659829:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746249.659873:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163497600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746249.659879:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788746249.659902:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788746249.659928:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f528000 x1875636163497600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746249.659947:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163497600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746249.722731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746249.772653:0:11459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:57:28 (1788746248) === 00000100:00100000:1.0:1788746250.094627:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.094680:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746250.094771:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441280 00000100:00100000:2.0:1788746250.094780:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441280 00000100:00100000:2.0:1788746250.094856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:2.0:1788746250.094866:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141441280:12345-192.168.206.24@tcp:41:mkdir.0 00000004:00000024:2.0:1788746250.094904:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788746250.095003:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141441280:12345-192.168.206.24@tcp:41:mkdir.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746250.095023:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00080000:1.0:1788746250.095673:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746250.095796:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441408 00000100:00100000:3.0:1788746250.095804:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441408 00000100:00100000:3.0:1788746250.095847:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:3.0:1788746250.095856:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9668:x1875636141441408:12345-192.168.206.24@tcp:700:mkdir.0 00000100:00100000:3.0:1788746250.095926:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9668:x1875636141441408:12345-192.168.206.24@tcp:700:mkdir.0 Request processed in 70us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746250.095933:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:1.0:1788746250.104654:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.104742:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441664 00000100:00100000:3.0:1788746250.104752:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441664 00000100:00100000:3.0:1788746250.104801:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:3.0:1788746250.104810:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9668:x1875636141441664:12345-192.168.206.24@tcp:36:mkdir.0 00010000:00010000:3.0:1788746250.104855:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746250.104920:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b309923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b137 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.104939:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412500) 00010000:00010000:3.0:1788746250.104949:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746250.105703:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.105719:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.105731:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.105767:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.105775:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.105781:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746250.107046:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788746250.107060:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107069:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107076:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107081:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746250.107086:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107100:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107113:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746250.107116:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746250.107121:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.107127:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746250.107149:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b7781d4a reply state 000000004015938b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.107157:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746250.107478:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9668:x1875636141441664:12345-192.168.206.24@tcp:36:mkdir.0 Request processed in 2666us (2829us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788746250.107486:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00010000:00010000:0.0:1788746250.111554:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111572:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111593:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111600:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746250.111604:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111612:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111628:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cd46e1acc00) 00010000:00010000:0.0:1788746250.111631:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746250.111636:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.111643:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309a49 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746250.131511:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746250.131678:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141441792 00000100:00100000:2.0:1788746250.131687:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141441792 00000100:00100000:2.0:1788746250.131745:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:2.0:1788746250.131755:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9669:x1875636141441792:12345-192.168.206.24@tcp:101:chmod.0 00010000:00010000:2.0:1788746250.131775:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746250.131795:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.131856:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.131888:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.131900:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746250.131934:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788746250.131938:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746250.131986:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.132020:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1bc expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.132041:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1bc expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.132050:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746250.132053:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746250.132056:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746250.132272:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9669:x1875636141441792:12345-192.168.206.24@tcp:101:chmod.0 Request processed in 516us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746250.132280:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:1.0:1788746250.138516:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746250.138788:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442048 00000100:00100000:0.0:1788746250.138798:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442048 00000100:00100000:0.0:1788746250.138859:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:0.0:1788746250.138869:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9669:x1875636141442048:12345-192.168.206.24@tcp:36:chmod.0 00010000:00010000:0.0:1788746250.138922:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746250.138948:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1bc expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.138980:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:0.0:1788746250.138991:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746250.139037:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.139246:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.139257:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746250.140959:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000291e15b8 reply state 000000000c4baa08 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.140974:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788746250.140985:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788746250.141085:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:9669:x1875636141442048:12345-192.168.206.24@tcp:36:chmod.0 Request processed in 2215us (2575us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788746250.141105:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00010000:00010000:2.0:1788746250.151488:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151506:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151514:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151519:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09a400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746250.151524:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151531:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151546:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412b00) 00010000:00010000:2.0:1788746250.151549:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788746250.151553:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.151559:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a5e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.170843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746250.170940:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442176 00000100:00100000:0.0:1788746250.170948:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442176 00000100:00100000:0.0:1788746250.171017:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:0.0:1788746250.171027:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9670:x1875636141442176:12345-192.168.206.24@tcp:101:chown.0 00010000:00010000:0.0:1788746250.171059:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746250.171083:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1c3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171172:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171185:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171196:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746250.171238:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788746250.171242:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746250.171276:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171301:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b309a65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1c3 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171327:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1c3 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.171335:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412d00) 00010000:00010000:0.0:1788746250.171338:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746250.171342:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8c00, rc 0) 00000100:00100000:0.0:1788746250.171441:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:9670:x1875636141442176:12345-192.168.206.24@tcp:101:chown.0 Request processed in 416us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746250.171449:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:1.0:1788746250.180266:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.181097:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442304 00000100:00100000:3.0:1788746250.181109:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442304 00000100:00100000:3.0:1788746250.181185:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:3.0:1788746250.181196:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:9670:x1875636141442304:12345-192.168.206.24@tcp:101:chown.0 00010000:00010000:3.0:1788746250.181216:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746250.181236:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309a73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1ca expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181299:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181314:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181326:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181364:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181373:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181380:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181667:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181677:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181684:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746250.181713:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788746250.181717:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746250.181736:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181747:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181755:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181761:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181777:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746250.181782:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181789:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181801:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412d00) 00010000:00010000:3.0:1788746250.181804:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746250.181810:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181817:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181830:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181836:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181841:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181846:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746250.181848:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181853:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181871:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cd44773e300) 00010000:00010000:3.0:1788746250.181874:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746250.181877:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181883:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309a81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181915:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309a73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ca expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181929:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ca expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.181935:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd44773ed00) 00010000:00010000:3.0:1788746250.181937:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746250.181939:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941c00, rc 0) 00000100:00100000:3.0:1788746250.182127:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:9670:x1875636141442304:12345-192.168.206.24@tcp:101:chown.0 Request processed in 932us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746250.182135:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746250.189319:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746250.189425:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442560 00000100:00100000:0.0:1788746250.189434:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442560 00000100:00100000:0.0:1788746250.189492:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:0.0:1788746250.189502:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:9670:x1875636141442560:12345-192.168.206.24@tcp:36:chown.0 00010000:00010000:0.0:1788746250.189727:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746250.189754:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309a88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ca expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.189773:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd44773ed00) 00010000:00010000:0.0:1788746250.189785:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746250.189809:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.189821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.189831:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788746250.337718:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788746250.338024:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007cef6868 reply state 0000000084495a46 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.338038:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788746250.338052:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788746250.338164:0:5851:0:(ldlm_lib.c:3495:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788746250.338183:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9670:x1875636141442560:12345-192.168.206.24@tcp:36:chown.0 Request processed in 148680us (148869us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788746250.338192:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00010000:00010000:0.0:1788746250.338318:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338329:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338336:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338342:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746250.338345:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338352:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338367:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:0.0:1788746250.338370:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788746250.338374:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.338380:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309a8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746250.375560:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746250.375741:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442688 00000100:00100000:2.0:1788746250.375750:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442688 00000100:00100000:2.0:1788746250.375806:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:2.0:1788746250.375816:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9671:x1875636141442688:12345-192.168.206.24@tcp:101:touch.500 00010000:00010000:2.0:1788746250.375837:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746250.376327:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1d1 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746250.388181:0:8618:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 11796us 00010000:00010000:1.0:1788746250.404654:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.404677:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.404690:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.404707:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.404715:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.404722:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405689:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405702:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405711:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746250.405737:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746250.405741:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746250.405777:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405789:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405796:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405802:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405809:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.405813:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405820:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405831:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412d00) 00010000:00010000:1.0:1788746250.405841:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746250.405847:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.405853:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309a9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407532:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407540:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407547:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407553:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.407557:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407564:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407576:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cd4511ad600) 00010000:00010000:1.0:1788746250.407579:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746250.407583:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407589:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407635:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d1 expref: 8 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407669:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d1 expref: 7 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.407677:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746250.407680:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788746250.407682:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478a00, rc 0) 00000100:00100000:1.0:1788746250.407752:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9671:x1875636141442688:12345-192.168.206.24@tcp:101:touch.500 Request processed in 31936us (32200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746250.407760:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:0.0:1788746250.418579:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.419783:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141442944 00000100:00100000:3.0:1788746250.419795:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141442944 00000100:00100000:3.0:1788746250.419977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:3.0:1788746250.419990:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9671:x1875636141442944:12345-192.168.206.24@tcp:101:touch.500 00010000:00010000:3.0:1788746250.420020:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746250.420041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ab2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420573:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420587:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420598:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420611:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420617:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.420624:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746250.422187:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788746250.422621:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941a00/0xe59b64da5b309ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422636:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941a00/0xe59b64da5b309ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422646:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941a00/0xe59b64da5b309ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422679:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422696:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422702:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422708:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746250.422713:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422720:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422731:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:3.0:1788746250.422734:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746250.422739:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422745:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940800/0xe59b64da5b309ab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746250.422757:0:5849:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000960401da reply state 00000000c764878f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746250.422765:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788746250.422799:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ab2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d8 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422813:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941a00/0xe59b64da5b309ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d8 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.422832:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd44773e700) 00010000:00010000:3.0:1788746250.422835:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746250.422838:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941a00, rc 0) 00000100:00100000:3.0:1788746250.423490:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:9671:x1875636141442944:12345-192.168.206.24@tcp:101:touch.500 Request processed in 3500us (4915us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788746250.423499:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00010000:00010000:0.0:1788746250.428577:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428591:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428615:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428621:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746250.428626:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428634:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428649:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9cd44773e300) 00010000:00010000:0.0:1788746250.428652:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746250.428657:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.428663:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309ac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746250.443013:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.448179:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443200 00000100:00100000:3.0:1788746250.448193:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443200 00000100:00100000:3.0:1788746250.448317:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:3.0:1788746250.448330:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:9671:x1875636141443200:12345-192.168.206.24@tcp:36:touch.500 00010000:00010000:3.0:1788746250.448385:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746250.448430:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941a00/0xe59b64da5b309ac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d8 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.448446:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd44773e700) 00010000:00010000:3.0:1788746250.448457:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746250.448496:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.448507:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.448517:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746250.448643:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c139a842 reply state 00000000c4a14991 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746250.448668:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746250.448754:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+10:9671:x1875636141443200:12345-192.168.206.24@tcp:36:touch.500 Request processed in 427us (5759us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788746250.448762:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00010000:00010000:0.0:1788746250.459622:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459639:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459646:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459652:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746250.459657:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459680:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459701:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd44773ed00) 00010000:00010000:0.0:1788746250.459704:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746250.459711:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.459717:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309ad5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.459824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746250.459873:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443328 00000100:00100000:0.0:1788746250.459881:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443328 00000100:00100000:0.0:1788746250.459942:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:0.0:1788746250.459950:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:9671:x1875636141443328:12345-192.168.206.24@tcp:101:touch.500 00010000:00010000:0.0:1788746250.459981:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746250.460007:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309adc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1df expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.460058:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309adc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1df expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.460070:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309adc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1df expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.460084:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:0.0:1788746250.460086:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746250.460089:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9a00, rc 0) 00000100:00100000:0.0:1788746250.460334:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:9671:x1875636141443328:12345-192.168.206.24@tcp:101:touch.500 Request processed in 383us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746250.460342:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:0.0:1788746250.464654:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.464857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443456 00000100:00100000:3.0:1788746250.464867:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443456 00000100:00100000:3.0:1788746250.464926:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:3.0:1788746250.464934:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875636141443456:12345-192.168.206.24@tcp:8:touch.500 00010000:00080000:3.0:1788746250.464976:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:3.0:1788746250.465017:0:6682:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b309ae3 00002000:00100000:3.0:1788746250.465032:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 783b9179-e60a-4972-9e46-67c8ee44ca13/ffff9cd47d1ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746250.465054:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746250.465280:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788746250.465309:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746250.465377:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141443456:12345-192.168.206.24@tcp:8:touch.500 Request processed in 442us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746250.465387:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:2.0:1788746250.469730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.469860:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443584 00000100:00100000:3.0:1788746250.469871:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443584 00000100:00100000:3.0:1788746250.469946:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:3.0:1788746250.469956:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:0:x1875636141443584:12345-192.168.206.24@tcp:2:touch.500 00000100:00080000:1.0:1788746250.470258:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788746250.515565:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788746250.515582:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000100:00100000:1.0:1788746250.515807:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:0:x1875636141443584:12345-192.168.206.24@tcp:2:touch.500 Request processed in 45848us (46080us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788746250.515819:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:2.0:1788746250.518087:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746250.518221:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443840 00000100:00100000:3.0:1788746250.518231:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443840 00000100:00100000:3.0:1788746250.518287:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:3.0:1788746250.518296:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+10:9671:x1875636141443840:12345-192.168.206.24@tcp:35:touch.500 00000100:00100000:0.0:1788746250.528478:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+11:9671:x1875636141443840:12345-192.168.206.24@tcp:35:touch.500 Request processed in 10174us (10391us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788746250.528493:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:0.0:1788746250.542455:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.542539:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141443968 00000100:00100000:1.0:1788746250.542548:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141443968 00000100:00100000:1.0:1788746250.542604:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:1.0:1788746250.542614:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+11:9672:x1875636141443968:12345-192.168.206.24@tcp:101:rm.0 00010000:00010000:1.0:1788746250.542635:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746250.542655:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1e6 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542717:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542730:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542757:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746250.542792:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746250.542796:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746250.542832:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542860:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1e6 expref: 13 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542876:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1e6 expref: 12 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.542883:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746250.542886:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746250.542889:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478000, rc 0) 00000100:00100000:1.0:1788746250.542948:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+12:9672:x1875636141443968:12345-192.168.206.24@tcp:101:rm.0 Request processed in 336us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746250.542954:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:2.0:1788746250.558628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.558782:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141444224 00000100:00100000:1.0:1788746250.558791:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141444224 00000100:00100000:1.0:1788746250.558854:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:1.0:1788746250.558864:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+12:9672:x1875636141444224:12345-192.168.206.24@tcp:101:rm.0 00010000:00010000:1.0:1788746250.558883:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746250.558902:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309af8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746250.559028:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788746250.559181:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309af8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ed expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.559196:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412d00) 00010000:00010000:1.0:1788746250.559199:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746250.559203:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309af8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ed expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.559218:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478200, rc 0) 00000100:00100000:1.0:1788746250.559294:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:9672:x1875636141444224:12345-192.168.206.24@tcp:101:rm.0 Request processed in 431us (674us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788746250.559301:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:2.0:1788746250.565750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.565832:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141444352 00000100:00100000:1.0:1788746250.565840:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141444352 00000100:00100000:1.0:1788746250.565891:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:1.0:1788746250.565902:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:9672:x1875636141444352:12345-192.168.206.24@tcp:37:rm.0 00000100:00100000:1.0:1788746250.575051:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:9672:x1875636141444352:12345-192.168.206.24@tcp:37:rm.0 Request processed in 9142us (9301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746250.575064:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:2.0:1788746250.587806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746250.592271:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141444608 00000100:00100000:0.0:1788746250.592285:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141444608 00000100:00100000:0.0:1788746250.592416:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:0.0:1788746250.592427:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:9672:x1875636141444608:12345-192.168.206.24@tcp:35:rm.0 00000100:00100000:0.0:1788746250.594615:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:9672:x1875636141444608:12345-192.168.206.24@tcp:35:rm.0 Request processed in 2180us (6807us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788746250.594628:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746250.599329:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746250.599550:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141444864 00000100:00100000:2.0:1788746250.599561:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141444864 00000100:00100000:2.0:1788746250.599624:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:2.0:1788746250.599635:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+14:9672:x1875636141444864:12345-192.168.206.24@tcp:101:rm.0 00010000:00010000:2.0:1788746250.599659:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746250.599679:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309b06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1f4 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.599771:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309b0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.599802:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309b0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.599815:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309b0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746250.599828:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788746250.599958:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309b06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1f4 expref: 17 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.600191:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309b0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1f4 expref: 16 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.600202:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:2.0:1788746250.600204:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746250.600208:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746250.600276:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141444864:12345-192.168.206.24@tcp:101:rm.0 Request processed in 643us (956us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788746250.600283:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:2.0:1788746250.629165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.629359:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141444992 00000100:00100000:1.0:1788746250.629369:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141444992 00000100:00100000:1.0:1788746250.629453:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:1.0:1788746250.629463:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141444992:12345-192.168.206.24@tcp:41:rm.0 00000004:00000024:1.0:1788746250.629526:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788746250.629611:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141444992:12345-192.168.206.24@tcp:41:rm.0 Request processed in 149us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746250.629628:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:2.0:1788746250.634749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.634862:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141445120 00000100:00100000:1.0:1788746250.634872:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141445120 00000100:00100000:1.0:1788746250.634933:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:1.0:1788746250.634943:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141445120:12345-192.168.206.24@tcp:101:rm.0 00010000:00010000:1.0:1788746250.634963:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746250.635069:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309b1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b1fb expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635146:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635160:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635171:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635303:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635311:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635318:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635591:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635615:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635623:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746250.635652:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788746250.635656:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746250.635672:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635683:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635690:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635695:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635701:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635706:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.635710:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635716:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635726:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746250.635730:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746250.635740:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635747:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b309b22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635761:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635767:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635773:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635778:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.635781:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635786:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635794:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9cd4511ad600) 00010000:00010000:1.0:1788746250.635796:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746250.635799:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635805:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b309b29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635836:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b309b1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1fb expref: 18 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635861:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1fb expref: 17 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.635868:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746250.635871:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746250.635873:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400e00, rc 0) 00000100:00100000:1.0:1788746250.635989:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+17:9672:x1875636141445120:12345-192.168.206.24@tcp:101:rm.0 Request processed in 1048us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746250.636007:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:0.0:1788746250.654584:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746250.654897:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141445376 00000100:00100000:1.0:1788746250.654907:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141445376 00000100:00100000:1.0:1788746250.654963:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:1.0:1788746250.655060:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+17:9672:x1875636141445376:12345-192.168.206.24@tcp:36:rm.0 00010000:00010000:1.0:1788746250.655381:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788746250.655439:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1fb expref: 17 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655465:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309adc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1df expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655477:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746250.655492:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b309af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1e6 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655501:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746250.655517:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746250.655539:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655553:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655563:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655576:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655583:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655590:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655704:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655713:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.655719:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746250.656659:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788746250.656671:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325061270878ns, next at 326061268827ns, rc = 0 00010000:00010000:1.0:1788746250.656732:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656754:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656762:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656770:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656776:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656782:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656807:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746250.656827:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656833:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656839:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656845:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.656849:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656856:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656875:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:1.0:1788746250.656878:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788746250.656883:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656888:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309b45 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656906:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656913:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656919:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656924:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746250.656926:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656933:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746250.656942:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746250.656945:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.656950:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b309b37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657225:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746250.657232:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657239:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746250.657242:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657248:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657258:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:3.0:1788746250.657260:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788746250.657263:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657268:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b309b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.657286:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746250.657288:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746250.657290:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1788746250.657612:0:5849:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000099880e45 reply state 0000000044cb8f04 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746250.657623:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788746250.657713:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141445376:12345-192.168.206.24@tcp:36:rm.0 Request processed in 2653us (3134us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788746250.657721:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:2.0:1788746250.661001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:0.0:1788746250.661726:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661739:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661746:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661753:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746250.661770:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661778:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661793:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9cd4511ad600) 00010000:00010000:0.0:1788746250.661796:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746250.661801:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746250.661807:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b309b3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746250.661904:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141445632 00000100:00100000:1.0:1788746250.661913:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141445632 00000100:00100000:1.0:1788746250.661963:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:1.0:1788746250.661986:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:9672:x1875636141445632:12345-192.168.206.24@tcp:35:rm.0 00000100:00100000:1.0:1788746250.662476:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141445632:12345-192.168.206.24@tcp:35:rm.0 Request processed in 490us (1491us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788746250.662484:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:3.0:1788746250.665151:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746250.665360:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141445888 00000100:00100000:2.0:1788746250.665370:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141445888 00000100:00100000:2.0:1788746250.665448:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:2.0:1788746250.665458:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:9672:x1875636141445888:12345-192.168.206.24@tcp:36:rm.0 00010000:00010000:2.0:1788746250.665512:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788746250.665547:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309b0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1f4 expref: 16 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665571:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478a00/0xe59b64da5b309aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1d1 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665582:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:2.0:1788746250.665596:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309a6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1c3 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665605:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412d00) 00010000:00010000:2.0:1788746250.665611:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746250.665633:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665645:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665655:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665666:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665672:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665679:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665912:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665926:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.665933:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746250.669704:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788746250.669726:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669736:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669744:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669750:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746250.669754:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669761:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669775:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:2.0:1788746250.669778:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788746250.669782:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669788:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309b61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669812:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669827:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669833:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669837:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746250.669840:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669846:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669853:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:2.0:1788746250.669855:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746250.669857:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746250.669862:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309b53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746250.669873:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c79cf02d reply state 0000000002b5c513 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746250.669881:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746250.670010:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+15:9672:x1875636141445888:12345-192.168.206.24@tcp:36:rm.0 Request processed in 4551us (4865us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788746250.670018:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 31 00010000:00010000:3.0:1788746250.686767:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686786:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686794:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686816:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746250.686820:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686827:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686844:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cd46e1ace00) 00010000:00010000:3.0:1788746250.686847:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746250.686852:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746250.686859:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309b5a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746250.746627:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746251.707375:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163497984:0@lo:400:kworker.0 00000100:00100000:1.0:1788746251.707463:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746251.707523:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746251.707530:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498112:0@lo:400:kworker.0 00000100:00100000:1.0:1788746251.707569:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746251.707603:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497984 00000100:00100000:1.0:1788746251.707609:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497984 00000100:00100000:1.0:1788746251.707660:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788746251.707669:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163497984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746251.707719:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163497984:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746251.707737:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788746251.707758:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746251.707787:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163497984:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708041:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708071:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746251.708096:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163498368:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708116:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746251.708142:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788746251.708149:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708174:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746251.708196:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708214:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746251.708238:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498112 00000100:00100000:3.0:1788746251.708242:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498112 00000100:00100000:3.0:1788746251.708274:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498368 00000100:00100000:3.0:1788746251.708284:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498368 00000100:00100000:3.0:1788746251.708328:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788746251.708335:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708371:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498112:12345-0@lo:400:kworker.0 Request processed in 37us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746251.708377:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788746251.708390:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788746251.708415:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708451:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163498368:12345-0@lo:400:kworker.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746251.708457:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788746251.708479:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497728 00000100:00100000:3.0:1788746251.708482:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497728 00000100:00100000:3.0:1788746251.708506:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788746251.708512:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708541:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163497728:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746251.708547:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788746251.708584:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163497856 00000100:00100000:3.0:1788746251.708588:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163497856 00000100:00100000:3.0:1788746251.708609:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498240 00000100:00100000:3.0:1788746251.708612:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498240 00000100:00100000:3.0:1788746251.708633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788746251.708639:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708670:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163497856:12345-0@lo:400:kworker.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746251.708676:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788746251.708696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788746251.708701:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163498240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708727:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163498240:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746251.708733:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788746251.708755:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746251.708758:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746251.708760:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746251.708779:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708789:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788746251.708798:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163497856:0@lo:400:kworker.0 00010000:00080000:3.0:1788746251.708808:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f5dd180 x1875636163498368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746251.708818:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163498368:0@lo:400:kworker.0 00010000:00080000:3.0:1788746251.709036:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f5dfb80 x1875636163498112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746251.709047:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498112:0@lo:400:kworker.0 00010000:00010000:2.0:1788746251.770822:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788746252.218687:0:8057:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326623285866ns, next at 327623283525ns, rc = 0 00000100:00100000:1.0:1788746252.218754:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746252.218825:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746252.218938:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498496 00000100:00100000:2.0:1788746252.218958:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498496 00000100:00100000:2.0:1788746252.219020:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746252.219030:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746252.219060:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746252.219113:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746252.219120:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788746252.219276:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d292a00 x1875636163498496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746252.219292:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746252.797761:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746253.818527:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746253.851991:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746253.852039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746253.852077:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746253.852106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746253.852140:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446144 00000100:00100000:2.0:1788746253.852151:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446144 00000100:00100000:2.0:1788746253.852219:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446400 00000100:00100000:2.0:1788746253.852222:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446400 00000100:00100000:2.0:1788746253.852253:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:2.0:1788746253.852264:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2349:x1875636141446144:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746253.852365:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2349:x1875636141446144:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746253.852373:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:2.0:1788746253.852433:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00100000:2.0:1788746253.852441:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141446400:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746253.852471:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141446400:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746253.852478:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00080000:2.0:1788746253.852500:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746253.852779:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446272 00000100:00100000:1.0:1788746253.852784:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446272 00000100:00100000:1.0:1788746253.852840:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:1.0:1788746253.852849:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2350:x1875636141446272:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746253.852889:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2350:x1875636141446272:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 41us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746253.852896:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:3.0:1788746253.854520:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446016 00000100:00100000:3.0:1788746253.854545:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446016 00000100:00100000:3.0:1788746253.854605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 248 00000100:00100000:3.0:1788746253.854629:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141446016:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746253.854701:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141446016:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 86us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746253.854710:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 248 00000100:00080000:2.0:1788746253.855257:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746254.779590:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746254.779623:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746254.779719:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746254.783305:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498624 00000100:00100000:2.0:1788746254.783327:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498624 00000100:00100000:2.0:1788746254.783460:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746254.783473:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746254.783526:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746254.783658:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163498624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746254.783665:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788746254.783788:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f529f80 x1875636163498624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746254.783814:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163498624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788746254.783904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746254.843199:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788746255.505735:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:1.0:1788746255.505755:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1788746255.505763:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788746255.505777:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788746255.505784:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788746255.506308:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163498752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788746255.506370:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746255.506489:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498752 00000100:00100000:1.0:1788746255.506496:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498752 00000100:00100000:1.0:1788746255.506556:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746255.506565:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163498752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788746255.506587:0:6680:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788746255.506618:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e1a0b, atime: 0x6a9e1a0b, ctime: 0x6a9e1a0b, blocks: 0x1 00010000:00010000:1.0:1788746255.506626:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.506654:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1788746255.506658:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746255.506664:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.506680:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.506690:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.506697:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.506714:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788746255.514051:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746255.514210:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163498752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7636us (7830us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788746255.514224:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788746255.514357:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746255.514366:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.514378:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746255.514383:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.514423:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.514442:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.514449:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b309b68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746255.514473:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746255.514475:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746255.514476:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788746255.514703:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45f529f80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788746255.514710:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163498752:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788746255.871361:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788746255.939886:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:02000400:1.0:1788746256.180319:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788746256.827900:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163499008:0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.827976:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746256.828022:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163499520:0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.828045:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746256.828153:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163499264:0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828181:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746256.828203:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788746256.828209:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828234:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746256.828258:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163499392:0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828278:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746256.828306:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499520 00000100:00100000:1.0:1788746256.828313:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499520 00000100:00100000:1.0:1788746256.828362:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499264 00000100:00100000:1.0:1788746256.828365:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499264 00000100:00100000:1.0:1788746256.828418:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788746256.828427:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163499520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828470:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163499520:12345-0@lo:400:kworker.0 Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746256.828476:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788746256.828491:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746256.828497:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828542:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163499264:12345-0@lo:400:kworker.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746256.828548:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746256.828564:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163498880 00000100:00100000:1.0:1788746256.828568:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163498880 00000100:00100000:1.0:1788746256.828592:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788746256.828598:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163498880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.828626:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163498880:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746256.828632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788746256.828739:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163498880:0@lo:400:kworker.0 00010000:00080000:1.0:1788746256.828752:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f529500 x1875636163499264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746256.828763:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163499264:0@lo:400:kworker.0 00000100:00080000:0.0:1788746256.828906:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746256.828979:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788746256.828985:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45f529f80, transno 4294967300 00000100:00100000:2.0:1788746256.829001:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163499520:0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.829010:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746256.829017:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163499136:0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.829041:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746256.829175:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499008 00000100:00100000:2.0:1788746256.829180:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499008 00000100:00100000:0.0:1788746256.846592:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499392 00000100:00100000:0.0:1788746256.846607:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499392 00000100:00100000:2.0:1788746256.846723:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499136 00000100:00100000:2.0:1788746256.846728:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499136 00000100:00100000:2.0:1788746256.846789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788746256.846805:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163499008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.846894:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163499008:12345-0@lo:400:kworker.0 Request processed in 96us (18918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746256.846912:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788746256.847000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788746256.847007:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163499136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746256.847039:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163499136:12345-0@lo:400:kworker.0 Request processed in 33us (17997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746256.847044:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788746256.847198:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746256.847235:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788746256.847247:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163499008:0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.849506:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788746256.849518:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163499392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746256.849597:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163499392:12345-0@lo:400:kworker.0 Request processed in 81us (21316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746256.849615:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788746256.849658:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163499392:0@lo:400:kworker.0 00000100:00080000:0.0:1788746256.849775:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788746256.890517:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746257.342993:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746257.343016:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163499648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746257.343082:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746257.343861:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163499648 00000100:00100000:0.0:1788746257.343870:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163499648 00000100:00100000:0.0:1788746257.343936:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788746257.343945:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163499648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746257.344000:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746257.344055:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163499648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746257.344063:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788746257.344123:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746257.344160:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163499648:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788746257.845728:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff67c85b10 20000000:00000080:3.0:1788746257.845747:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd45f5d0800 uarg=0000000000000000 20000000:01000000:3.0:1788746257.845782:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788746257.845789:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788746257.845793:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788746257.848108:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788746257.848848:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788746257.865177:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788746257.865240:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788746257.865298:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788746257.865318:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746257.865337:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865355:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865363:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865369:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865379:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865386:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865392:0:11658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865723:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865738:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 12 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.865753:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163499776:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746257.865863:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865874:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 12 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.865883:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163499904:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746257.865914:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.865923:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.865932:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500032:0@lo:104: 00000100:00100000:2.0:1788746257.866049:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746257.866138:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.866148:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.866169:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f677480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500160:0@lo:104: 00000100:00100000:2.0:1788746257.866199:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746257.866229:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.866237:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.866244:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500288:0@lo:104: 00000100:00100000:2.0:1788746257.866270:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746257.866280:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746257.866341:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788746257.866355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500032 00000100:00100000:1.0:1788746257.866361:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500032 00000100:00100000:1.0:1788746257.866413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500160 00000100:00100000:1.0:1788746257.866417:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500160 00000100:00100000:1.0:1788746257.866427:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500288 00000100:00100000:1.0:1788746257.866430:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500288 00000100:00100000:1.0:1788746257.866441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746257.866448:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+5:11658:x1875636163500032:12345-0@lo:104: 00010000:00010000:1.0:1788746257.866462:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866536:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746257.866542:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+5:11658:x1875636163500032:12345-0@lo:104: Request processed in 94us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746257.866548:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746257.866564:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746257.866570:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:11658:x1875636163500160:12345-0@lo:104: 00010000:00010000:1.0:1788746257.866587:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866620:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788746257.866625:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+4:11658:x1875636163500160:12345-0@lo:104: Request processed in 55us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746257.866631:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746257.866644:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788746257.866650:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d742050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:11658:x1875636163500288:12345-0@lo:104: 00010000:00010000:1.0:1788746257.866658:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866689:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788746257.866693:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d742050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85baee7e-e9e8-492f-b3b0-167696ca895f+3:11658:x1875636163500288:12345-0@lo:104: Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746257.866698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788746257.866732:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788746257.866737:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866744:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09be00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746257.866748:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866756:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746257.866763:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746257.866775:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746257.866802:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866808:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746257.866827:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866834:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09be00/0xe59b64da5b309a26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866847:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746257.866850:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866855:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479800 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746257.866858:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866865:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746257.866870:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746257.866875:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746257.866887:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866893:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746257.866905:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866911:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479800/0xe59b64da5b309a18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866920:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746257.866934:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866941:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09b400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746257.866944:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866960:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746257.866967:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746257.866972:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746257.866985:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.866991:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746257.867006:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.867012:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09b400/0xe59b64da5b309a0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b309a11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.867025:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746257.868053:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746257.868056:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746257.868064:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746257.868079:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746257.868098:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163500416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746257.868377:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163500544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788746257.868541:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500032:0@lo:104: 00000100:00100000:2.0:1788746257.868551:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f677480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500160:0@lo:104: 00000100:00100000:2.0:1788746257.868558:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163500288:0@lo:104: 00000100:00100000:0.0:1788746257.875183:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746257.875282:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500544 00000100:00100000:0.0:1788746257.875292:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500544 00010000:00010000:0.0:1788746257.875329:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 19 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746257.875361:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746257.875370:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163500544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746257.875384:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746257.875390:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 19 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.875416:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 19 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.875434:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45400/0xe59b64da5b309a1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309a18 expref: 19 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.875448:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746257.875487:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3317:x1875636163500544:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746257.875494:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746257.875818:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163500544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746257.877209:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163500672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746257.877271:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746257.877447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500672 00000100:00100000:2.0:1788746257.877456:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500672 00010000:00010000:2.0:1788746257.877491:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746257.877531:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788746257.877540:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3314:x1875636163500672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746257.877552:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746257.877557:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.877567:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.877599:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44400/0xe59b64da5b309a11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309a0a expref: 18 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.877612:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746257.877648:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3314:x1875636163500672:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746257.877655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788746257.878856:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163500672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746257.879799:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746257.879896:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500416 00000100:00100000:0.0:1788746257.879904:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500416 00010000:00010000:0.0:1788746257.879945:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 17 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746257.879988:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788746257.879997:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3316:x1875636163500416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746257.880010:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746257.880014:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 17 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.880023:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 17 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.880052:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44200/0xe59b64da5b309a2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b309a26 expref: 17 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746257.880077:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746257.880134:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3316:x1875636163500416:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746257.880368:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163500416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746257.883525:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788746257.885519:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746257.885623:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746257.886372:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446528 00000100:00100000:1.0:1788746257.886383:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446528 00010000:00010000:1.0:1788746257.886448:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 13 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746257.886481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446656 00000100:00100000:1.0:1788746257.886485:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446656 00010000:00010000:1.0:1788746257.886508:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746257.886531:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:1.0:1788746257.886541:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+14:2350:x1875636141446528:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746257.886557:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746257.886563:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886574:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886596:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746257.886649:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+14:2350:x1875636141446528:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 108us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746257.886656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:1.0:1788746257.886687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:1.0:1788746257.886694:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141446656:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746257.886701:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746257.886706:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 13 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886715:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 13 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886727:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886736:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886750:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886758:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886765:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886771:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886778:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746257.886782:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886801:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886810:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746257.886820:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746257.886840:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141446656:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 146us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746257.886847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 34 00010000:00010000:3.0:1788746257.888816:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45000/0xe59b64da5b309a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1b5 expref: 12 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746257.888837:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163499776:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746257.888849:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09b800/0xe59b64da5b309a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b1ae expref: 11 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746257.888882:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875636163499904:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746257.888915:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.889660:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.889669:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746257.889674:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45600/0xe59b64da5b309b6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746257.914530:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746258.940446:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746258.969259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746258.969304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746258.969339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746258.969372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746258.969388:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447040 00000100:00100000:1.0:1788746258.969429:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447040 00000100:00100000:1.0:1788746258.969499:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:1.0:1788746258.969509:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141447040:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746258.969589:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141447040:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746258.969595:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00080000:3.0:1788746258.969707:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746258.969751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446784 00000100:00100000:0.0:1788746258.969756:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446784 00000100:00100000:0.0:1788746258.969793:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 250 00000100:00100000:0.0:1788746258.969801:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2348:x1875636141446784:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746258.969859:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2348:x1875636141446784:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746258.969867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 250 00000100:00100000:2.0:1788746258.972260:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141446912 00000100:00100000:2.0:1788746258.972275:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141446912 00000100:00100000:2.0:1788746258.972351:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447168 00000100:00100000:2.0:1788746258.972354:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447168 00000100:00100000:2.0:1788746258.972388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 104 00000100:00100000:2.0:1788746258.972430:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141446912:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746258.972500:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141446912:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 104us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746258.972524:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 104 00000100:00100000:2.0:1788746258.972552:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 105 00000100:00100000:2.0:1788746258.972559:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141447168:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746258.972586:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141447168:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 27us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746258.972591:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 105 00000100:00080000:0.0:1788746258.973103:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746259.224953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.225155:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447296 00000100:00100000:1.0:1788746259.225164:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447296 00000100:00100000:1.0:1788746259.225218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 251 00000100:00100000:1.0:1788746259.225228:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+11:5590:x1875636141447296:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746259.225243:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746259.225263:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400000/0xe59b64da5b309b76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b202 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.225293:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400000/0xe59b64da5b309b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b202 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.225320:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400000/0xe59b64da5b309b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b202 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.225331:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400000, rc 0) 00000100:00100000:1.0:1788746259.225389:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447296:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 162us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.225395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 251 00000100:00100000:3.0:1788746259.228827:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.229070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447424 00000100:00100000:1.0:1788746259.229079:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447424 00000100:00100000:1.0:1788746259.229143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 252 00000100:00100000:1.0:1788746259.229153:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447424:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.229716:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447424:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 562us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.229724:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 252 00000100:00100000:2.0:1788746259.238537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.238615:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447552 00000100:00100000:1.0:1788746259.238623:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447552 00000100:00100000:1.0:1788746259.238675:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 253 00000100:00100000:1.0:1788746259.238685:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447552:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.238909:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447552:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 224us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.238923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 253 00000100:00100000:2.0:1788746259.241500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.241797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447680 00000100:00100000:1.0:1788746259.241805:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447680 00000100:00100000:1.0:1788746259.241857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 254 00000100:00100000:1.0:1788746259.241865:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:9942:x1875636141447680:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746259.242393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:9942:x1875636141447680:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 526us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.242421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 254 00000100:00100000:3.0:1788746259.265761:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746259.265874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447808 00000100:00100000:0.0:1788746259.265884:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447808 00000100:00100000:0.0:1788746259.265955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 255 00000100:00100000:0.0:1788746259.265965:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:9942:x1875636141447808:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746259.266223:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:9942:x1875636141447808:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 258us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746259.266231:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 255 00000100:00100000:2.0:1788746259.273251:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.273459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141447936 00000100:00100000:1.0:1788746259.273469:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141447936 00000100:00100000:1.0:1788746259.273524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 256 00000100:00100000:1.0:1788746259.273534:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+12:5590:x1875636141447936:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746259.273549:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746259.273567:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477401600/0xe59b64da5b309b7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b209 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.273593:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477401600/0xe59b64da5b309b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b209 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.273605:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477401600/0xe59b64da5b309b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b209 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.273613:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401600, rc 0) 00000100:00100000:1.0:1788746259.273673:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141447936:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.273681:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 256 00000100:00100000:2.0:1788746259.284526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746259.285128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448064 00000100:00100000:3.0:1788746259.285138:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448064 00000100:00100000:3.0:1788746259.285197:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 257 00000100:00100000:3.0:1788746259.285207:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141448064:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.285535:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141448064:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 329us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.285544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 257 00000100:00100000:3.0:1788746259.291455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746259.291703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448192 00000100:00100000:0.0:1788746259.291713:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448192 00000100:00100000:0.0:1788746259.291765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 258 00000100:00100000:0.0:1788746259.291775:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141448192:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.292022:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:5590:x1875636141448192:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 248us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746259.292030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 258 00000100:00100000:2.0:1788746259.296963:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746259.297053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448320 00000100:00100000:1.0:1788746259.297070:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448320 00000100:00100000:1.0:1788746259.297132:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 259 00000100:00100000:1.0:1788746259.297142:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:9945:x1875636141448320:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746259.297393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:9945:x1875636141448320:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 251us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.297444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 259 00000100:00100000:2.0:1788746259.321608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746259.323341:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448448 00000100:00100000:3.0:1788746259.323355:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448448 00000100:00100000:3.0:1788746259.323461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 260 00000100:00100000:3.0:1788746259.323473:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:9945:x1875636141448448:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746259.323722:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:9945:x1875636141448448:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 251us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.323736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 260 10000000:01000000:0.0:1788746259.388087:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746259.388095:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd47ebce000 from 7 10000000:01000000:0.0:1788746259.388100:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746259.388145:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746259.388156:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746259.388185:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746259.388210:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163500800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.388300:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.388361:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd3452616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.388516:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500800 00000100:00100000:3.0:1788746259.388524:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500800 00000100:00100000:3.0:1788746259.388579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788746259.388588:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+16:5846:x1875636163500800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746259.388600:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746259.388613:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f940800/0xe59b64da5b309b8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309b84 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.388635:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f940800/0xe59b64da5b309b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309b84 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.388646:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f940800/0xe59b64da5b309b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309b84 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.388655:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940800, rc 0) 00000100:00100000:3.0:1788746259.388705:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163500800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.388711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788746259.390835:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163500800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746259.390862:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746259.390873:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746259.390973:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163500928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.391026:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.391075:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd3452616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746259.392480:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163500928 00000100:00100000:2.0:1788746259.392492:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163500928 00000100:00100000:2.0:1788746259.392552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788746259.392562:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163500928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746259.392866:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163500928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746259.392875:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788746259.393175:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163500928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.393242:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.393291:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.393377:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd3452616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.399101:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501056 00000100:00100000:1.0:1788746259.399370:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501056 00000100:00100000:1.0:1788746259.399524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788746259.399535:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163501056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.399792:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163501056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (6499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.399800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788746259.399905:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746259.403692:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11671:1875636163501184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746259.403782:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.410423:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746259.412227:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501184 00000100:00100000:2.0:1788746259.412240:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501184 00000100:00100000:2.0:1788746259.412295:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788746259.412305:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:11671:x1875636163501184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746259.412589:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:11671:x1875636163501184:12345-0@lo:502:llog_process_th.0 Request processed in 286us (8806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746259.412604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788746259.413103:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11671:1875636163501184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746259.413263:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746259.413274:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746259.413276:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788746259.413282:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd47ebce000 00000020:00000080:0.0:1788746259.413285:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788746259.413393:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11671:1875636163501312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746259.413477:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.413508:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.415073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501312 00000100:00100000:1.0:1788746259.415084:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501312 00000100:00100000:1.0:1788746259.415252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788746259.415263:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:11671:x1875636163501312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746259.415532:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:11671:x1875636163501312:12345-0@lo:502:llog_process_th.0 Request processed in 271us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.415540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788746259.417291:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11671:1875636163501312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746259.417331:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746259.417340:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746259.417342:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788746259.417346:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788746259.418219:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788746259.418244:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746259.418254:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.418265:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746259.418274:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746259.418276:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448dea800 from 7 10000000:01000000:1.0:1788746259.418279:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746259.418312:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.418329:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.418338:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746259.418359:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.419652:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746259.419995:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4411caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.420094:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501440 00000100:00100000:3.0:1788746259.420103:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501440 00000100:00100000:3.0:1788746259.420227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788746259.420236:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+17:5846:x1875636163501440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746259.420251:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746259.420267:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd45f941a00/0xe59b64da5b309b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309b92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.420291:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd45f941a00/0xe59b64da5b309b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309b92 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.420313:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd45f941a00/0xe59b64da5b309b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309b92 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.420321:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941a00, rc 0) 00000100:00100000:3.0:1788746259.420379:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163501440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.420386:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788746259.422951:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746259.422979:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.422991:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746259.423076:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.423139:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746259.423177:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4411caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.431545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501568 00000100:00100000:3.0:1788746259.431559:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501568 00000100:00100000:3.0:1788746259.431610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788746259.431620:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163501568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.431902:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163501568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (8763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.431910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788746259.432100:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.432158:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.432204:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746259.432241:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4411caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.432529:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501696 00000100:00100000:3.0:1788746259.432535:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501696 00000100:00100000:3.0:1788746259.432567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788746259.432574:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163501696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.432714:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163501696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.432721:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788746259.433571:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163501696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.438231:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11673:1875636163501824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746259.438320:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746259.438367:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4411cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.438529:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501824 00000100:00100000:3.0:1788746259.438537:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501824 00000100:00100000:3.0:1788746259.438590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788746259.438600:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:11673:x1875636163501824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746259.438822:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+18:11673:x1875636163501824:12345-0@lo:502:llog_process_th.0 Request processed in 223us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.438830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788746259.439293:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11673:1875636163501824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746259.439325:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746259.439334:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746259.439336:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788746259.439342:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd448dea800 00000020:00000080:1.0:1788746259.439345:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788746259.439470:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11673:1875636163501952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746259.439510:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746259.439539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163501952 00000100:00100000:1.0:1788746259.439544:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163501952 00000100:00100000:1.0:1788746259.439572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788746259.439580:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:11673:x1875636163501952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746259.439718:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:11673:x1875636163501952:12345-0@lo:502:llog_process_th.0 Request processed in 138us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.439725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788746259.439764:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467d016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.439777:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11673:1875636163501952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746259.439796:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746259.439800:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746259.439802:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788746259.439805:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788746259.440696:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788746259.440723:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746259.440733:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.440745:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746259.440756:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788746259.440758:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448caf000 from 7 10000000:01000000:3.0:1788746259.440761:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746259.440795:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.440802:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.440812:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746259.440830:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.440880:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746259.444692:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d393780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.449650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502080 00000100:00100000:1.0:1788746259.449663:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502080 00000100:00100000:1.0:1788746259.449710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788746259.449719:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:5846:x1875636163502080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746259.449745:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746259.449760:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477401200/0xe59b64da5b309ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b309ba0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.449785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477401200/0xe59b64da5b309ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b309ba0 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.449796:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477401200/0xe59b64da5b309ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b309ba0 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746259.449804:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401200, rc 0) 00000100:00100000:1.0:1788746259.449867:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163502080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (8986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.449873:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788746259.453861:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746259.453891:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.453933:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746259.454020:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.454090:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746259.454147:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d393780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.454418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502208 00000100:00100000:1.0:1788746259.454426:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502208 00000100:00100000:1.0:1788746259.454460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788746259.454468:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163502208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.454712:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163502208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.454720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788746259.456268:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.456325:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.456390:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746259.456470:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d393780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746259.456650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502336 00000100:00100000:1.0:1788746259.456656:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502336 00000100:00100000:1.0:1788746259.456697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788746259.456706:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163502336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746259.456894:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:5846:x1875636163502336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746259.456911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788746259.457725:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85baee7e-e9e8-492f-b3b0-167696ca895f:5846:1875636163502336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746259.471676:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11675:1875636163502464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746259.471772:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746259.471855:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d393840 going to sleep for 11 seconds 00000100:00100000:0.0:1788746259.477612:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502464 00000100:00100000:0.0:1788746259.477626:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502464 00000100:00100000:0.0:1788746259.481528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788746259.481542:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:11675:x1875636163502464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746259.481806:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:11675:x1875636163502464:12345-0@lo:502:llog_process_th.0 Request processed in 266us (10033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746259.481814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788746259.483462:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f603480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11675:1875636163502464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746259.483507:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746259.483518:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746259.483520:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788746259.483530:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd448caf000 00000020:00000080:2.0:1788746259.483533:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788746259.483619:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11675:1875636163502592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746259.483684:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746259.483717:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4457833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746259.484166:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502592 00000100:00100000:3.0:1788746259.484172:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502592 00000100:00100000:3.0:1788746259.484229:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788746259.484238:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:11675:x1875636163502592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746259.484479:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:11675:x1875636163502592:12345-0@lo:502:llog_process_th.0 Request processed in 242us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746259.484487:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788746259.485981:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85baee7e-e9e8-492f-b3b0-167696ca895f:11675:1875636163502592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746259.486030:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746259.486040:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746259.486042:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788746259.486047:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788746259.487277:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788746259.487300:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746259.487311:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746259.487339:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746259.488591:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788746259.901380:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746259.901431:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746259.901498:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746259.901791:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502720 00000100:00100000:2.0:1788746259.901801:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502720 00000100:00100000:2.0:1788746259.901878:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788746259.901888:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163502720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746259.901933:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746259.901996:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163502720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746259.902004:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788746259.902089:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f674e00 x1875636163502720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746259.902107:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163502720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788746259.902427:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746259.962665:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746260.539598:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788746260.986883:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746261.946794:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163503104:0@lo:400:kworker.0 00000100:00100000:3.0:1788746261.946862:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746261.946945:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746261.946952:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503232:0@lo:400:kworker.0 00000100:00100000:3.0:1788746261.946980:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746261.947015:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503232 00000100:00100000:3.0:1788746261.947022:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503232 00000100:00100000:3.0:1788746261.947089:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788746261.947106:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746261.947158:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503232:12345-0@lo:400:kworker.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746261.947164:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788746261.947187:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746261.947212:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f676d80 x1875636163503232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746261.947224:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503232:0@lo:400:kworker.0 00000100:00100000:2.0:1788746261.947431:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503104 00000100:00100000:2.0:1788746261.947446:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503104 00000100:00100000:2.0:1788746261.947482:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788746261.947489:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746261.947539:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163503104:12345-0@lo:400:kworker.0 Request processed in 50us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746261.947545:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788746261.947746:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163502848:0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.947781:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746261.947804:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163503360:0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.947824:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746261.947844:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788746261.947850:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163502976:0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.947868:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746261.947884:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163503488:0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.947915:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746261.947952:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503360 00000100:00100000:1.0:1788746261.947956:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503360 00000100:00100000:1.0:1788746261.947983:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502976 00000100:00100000:1.0:1788746261.947986:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502976 00000100:00100000:1.0:1788746261.948004:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788746261.948010:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163503360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.948042:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163503360:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746261.948048:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788746261.948063:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788746261.948077:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163502976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746261.948276:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503488 00000100:00100000:2.0:1788746261.948280:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503488 00000100:00100000:2.0:1788746261.948311:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746261.948319:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163503488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746261.948424:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163502848 00000100:00100000:3.0:1788746261.948448:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163502848 00000100:00100000:3.0:1788746261.948476:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788746261.948483:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163502848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746261.948643:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163503360:0@lo:400:kworker.0 00000100:00080000:0.0:1788746261.949091:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746261.949108:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746261.949135:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163503104:0@lo:400:kworker.0 00000100:00100000:2.0:1788746261.954305:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163503488:12345-0@lo:400:kworker.0 Request processed in 5978us (6379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746261.954322:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788746261.954459:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163503488:0@lo:400:kworker.0 00000100:00100000:1.0:1788746261.954627:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163502976:12345-0@lo:400:kworker.0 Request processed in 6549us (6755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746261.954638:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788746261.955462:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163502976:0@lo:400:kworker.0 00000100:00100000:3.0:1788746261.955679:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163502848:12345-0@lo:400:kworker.0 Request processed in 7195us (7895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746261.955690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788746261.955972:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163502848:0@lo:400:kworker.0 00010000:00010000:3.0:1788746262.012784:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746262.459591:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746262.459657:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746262.459838:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503616 00000100:00100000:2.0:1788746262.459845:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503616 00000100:00100000:2.0:1788746262.459893:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788746262.459902:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746262.459945:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746262.460000:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746262.460007:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788746262.460639:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746263.034683:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746264.058770:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746264.091568:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746264.091618:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746264.091651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746264.091686:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746264.091716:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448832 00000100:00100000:3.0:1788746264.091726:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448832 00000100:00100000:3.0:1788746264.091785:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:3.0:1788746264.091795:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141448832:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746264.091856:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141448832:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746264.091864:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00080000:3.0:1788746264.091884:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746264.091968:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448576 00000100:00100000:1.0:1788746264.091973:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448576 00000100:00100000:1.0:1788746264.092008:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 277 00000100:00100000:1.0:1788746264.092016:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141448576:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746264.092056:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141448576:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 40us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746264.092072:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 277 00000100:00100000:0.0:1788746264.092430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448704 00000100:00100000:0.0:1788746264.092435:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448704 00000100:00100000:0.0:1788746264.092479:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141448960 00000100:00100000:0.0:1788746264.092482:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141448960 00000100:00100000:0.0:1788746264.092505:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 109 00000100:00100000:0.0:1788746264.092512:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141448704:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746264.092545:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141448704:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 33us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746264.092551:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 109 00000100:00100000:0.0:1788746264.092569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 110 00000100:00100000:0.0:1788746264.092575:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141448960:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746264.092610:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141448960:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 34us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746264.092616:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 110 00000100:00080000:3.0:1788746264.095037:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746265.019001:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746265.019023:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746265.019107:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746265.019611:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503744 00000100:00100000:2.0:1788746265.019620:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503744 00000100:00100000:2.0:1788746265.019691:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746265.019700:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746265.019734:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746265.019779:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163503744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746265.019787:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788746265.020023:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746265.020065:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f674a80 x1875636163503744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746265.020083:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163503744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746265.082630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746266.106598:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746267.066877:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163504000:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.066954:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067025:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163504512:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067052:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067082:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788746267.067087:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163503872:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067116:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067134:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163504384:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067154:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067179:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067212:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067246:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746267.067252:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163504128:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067276:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746267.067304:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504512 00000100:00100000:1.0:1788746267.067311:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504512 00000100:00100000:1.0:1788746267.067354:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504256 00000100:00100000:1.0:1788746267.067358:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504256 00000100:00100000:1.0:1788746267.067381:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788746267.067390:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163504512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067475:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163504512:12345-0@lo:400:kworker.0 Request processed in 86us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746267.067483:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788746267.067499:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788746267.067506:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067538:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504256:12345-0@lo:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746267.067543:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788746267.067562:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504000 00000100:00100000:1.0:1788746267.067565:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504000 00000100:00100000:1.0:1788746267.067590:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504384 00000100:00100000:1.0:1788746267.067594:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504384 00000100:00100000:1.0:1788746267.067606:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504128 00000100:00100000:1.0:1788746267.067608:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504128 00000100:00100000:1.0:1788746267.067621:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788746267.067626:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163504000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067656:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163504000:12345-0@lo:400:kworker.0 Request processed in 30us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746267.067662:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788746267.067684:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788746267.067690:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163504384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067726:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163504384:12345-0@lo:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746267.067732:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788746267.067747:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788746267.067754:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163504128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067780:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163504128:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746267.067785:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788746267.067833:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163504128:0@lo:400:kworker.0 00010000:00080000:1.0:1788746267.067846:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd47d08f480 x1875636163504256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746267.067856:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067884:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163504384:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067893:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163504000:0@lo:400:kworker.0 00000100:00100000:1.0:1788746267.067916:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163504512:0@lo:400:kworker.0 00000100:00080000:3.0:1788746267.068090:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746267.068095:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746267.068097:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746267.068111:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163503872 00000100:00100000:3.0:1788746267.068115:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163503872 00000100:00100000:3.0:1788746267.068149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788746267.068157:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163503872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746267.068208:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163503872:12345-0@lo:400:kworker.0 Request processed in 53us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746267.068214:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788746267.068247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163503872:0@lo:400:kworker.0 00010000:00010000:1.0:1788746267.135326:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746267.585194:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746267.585216:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746267.585293:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746267.586890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504640 00000100:00100000:0.0:1788746267.586909:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504640 00000100:00100000:0.0:1788746267.586981:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788746267.586990:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746267.587027:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746267.587125:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746267.587148:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788746267.587459:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746268.154943:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746269.180203:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746269.207906:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746269.207946:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746269.207998:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746269.208019:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449216 00000100:00100000:2.0:1788746269.208029:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449216 00000100:00100000:0.0:1788746269.208032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746269.208059:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449344 00000100:00100000:0.0:1788746269.208063:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449344 00000100:00100000:2.0:1788746269.208082:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449472 00000100:00100000:2.0:1788746269.208085:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449472 00000100:00100000:0.0:1788746269.208090:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:0.0:1788746269.208098:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141449344:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746269.208161:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141449344:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746269.208169:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:2.0:1788746269.208184:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:2.0:1788746269.208192:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141449216:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:0.0:1788746269.208218:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746269.208221:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141449216:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00080000:0.0:1788746269.208222:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746269.208227:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:0.0:1788746269.208238:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:0.0:1788746269.208244:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141449472:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746269.208270:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141449472:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746269.208276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:3.0:1788746269.216728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449088 00000100:00100000:3.0:1788746269.216743:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449088 00000100:00100000:3.0:1788746269.216818:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 279 00000100:00100000:3.0:1788746269.216829:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141449088:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746269.216912:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141449088:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 85us (8913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746269.216920:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 279 00000100:00100000:1.0:1788746270.138705:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746270.138784:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746270.138989:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504768 00000100:00100000:0.0:1788746270.138997:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504768 00000100:00100000:0.0:1788746270.139065:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788746270.139075:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746270.139106:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746270.139152:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163504768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746270.139166:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788746270.139310:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f674000 x1875636163504768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746270.139328:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163504768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788746270.139464:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788746270.203924:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746270.780301:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788746271.227564:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746272.186745:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163504896:0@lo:400:kworker.0 00000100:00100000:3.0:1788746272.186787:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.186818:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746272.186894:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163505408:0@lo:400:kworker.0 00000100:00100000:3.0:1788746272.186923:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746272.186927:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163505280:0@lo:400:kworker.0 00000100:00100000:3.0:1788746272.186958:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163505536:0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.186965:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746272.186993:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746272.187001:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746272.187008:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163505152:0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.187036:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746272.187038:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505280 00000100:00100000:3.0:1788746272.187047:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505280 00000100:00100000:1.0:1788746272.187069:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505536 00000100:00100000:1.0:1788746272.187074:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505536 00000100:00100000:1.0:1788746272.187144:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788746272.187155:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163505536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.187212:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163505536:12345-0@lo:400:kworker.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746272.187220:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788746272.187242:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746272.187255:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505024 00000100:00100000:1.0:1788746272.187258:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505024 00000100:00100000:1.0:1788746272.187286:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505152 00000100:00100000:1.0:1788746272.187289:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505152 00000100:00100000:1.0:1788746272.187330:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788746272.187338:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163505024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.187373:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163505024:12345-0@lo:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746272.187379:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788746272.187393:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.187394:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788746272.187429:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163505152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746272.187437:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163505536:0@lo:400:kworker.0 00000100:00100000:1.0:1788746272.187467:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163505152:12345-0@lo:400:kworker.0 Request processed in 40us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746272.187474:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746272.187479:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788746272.187492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505408 00000100:00100000:1.0:1788746272.187497:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505408 00000100:00100000:0.0:1788746272.187522:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788746272.187532:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163505408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746272.187573:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163505408:12345-0@lo:400:kworker.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746272.187639:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163505152:0@lo:400:kworker.0 00000100:00080000:1.0:1788746272.187661:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746272.187677:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163505408:0@lo:400:kworker.0 00000100:00100000:2.0:1788746272.187827:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163504896 00000100:00100000:2.0:1788746272.187832:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163504896 00000100:00100000:2.0:1788746272.187879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788746272.187887:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163504896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746272.187928:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163504896:12345-0@lo:400:kworker.0 Request processed in 42us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746272.187933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788746272.187973:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163504896:0@lo:400:kworker.0 00000100:00100000:3.0:1788746272.192030:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788746272.192044:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163505280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788746272.192114:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746272.192140:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163505280:12345-0@lo:400:kworker.0 Request processed in 99us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746272.192147:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788746272.192247:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f675880 x1875636163505280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746272.192262:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163505280:0@lo:400:kworker.0 00000100:00100000:0.0:1788746272.196699:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:1.0:1788746272.250747:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746272.700594:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746272.700618:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746272.700688:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746272.701976:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505664 00000100:00100000:0.0:1788746272.701988:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505664 00000100:00100000:0.0:1788746272.702050:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788746272.702059:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163505664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746272.702105:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746272.702179:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163505664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746272.702187:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746272.702252:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163505664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746273.278664:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746274.298891:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746274.328998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746274.329045:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746274.329171:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449728 00000100:00100000:1.0:1788746274.329181:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449728 00000100:00100000:0.0:1788746274.329220:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449600 00000100:00100000:0.0:1788746274.329227:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449600 00000100:00100000:1.0:1788746274.329263:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:0.0:1788746274.329270:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 281 00000100:00100000:1.0:1788746274.329278:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141449728:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746274.329283:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141449600:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:2.0:1788746274.329359:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746274.329464:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141449600:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 185us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746274.329471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 281 00000100:00100000:1.0:1788746274.330588:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141449728:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 1309us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746274.330599:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:3.0:1788746274.356392:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746274.356466:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449856 00000100:00100000:1.0:1788746274.356487:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449856 00000100:00080000:3.0:1788746274.356568:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746274.356570:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746274.356583:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2346:x1875636141449856:12345-192.168.206.24@tcp:9:kworker.0 00000020:00000080:1.0:1788746274.356612:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309ae3 00000100:00080000:1.0:1788746274.356621:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1aa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746274.356668:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788746274.357146:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+2:2346:x1875636141449856:12345-192.168.206.24@tcp:9:kworker.0 Request processed in 564us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746274.357153:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00010000:00010000:3.0:1788746274.365350:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746274.368445:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746274.370849:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141449984 00000100:00100000:3.0:1788746274.370872:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141449984 00000100:00100000:3.0:1788746274.370944:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:3.0:1788746274.370954:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141449984:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:2.0:1788746274.371104:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746274.371214:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141449984:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 260us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746274.371222:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:1.0:1788746275.258634:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746275.258657:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746275.258728:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746275.258886:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505792 00000100:00100000:0.0:1788746275.258896:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505792 00000100:00100000:0.0:1788746275.258956:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746275.258966:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163505792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746275.258999:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746275.259049:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163505792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746275.259056:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788746275.259094:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f674a80 x1875636163505792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746275.259111:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163505792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788746275.259193:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746275.322693:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788746276.319620:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:1.0:1788746276.319629:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cd47d1ac000/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:0.0:1788746276.319760:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47d1ac000/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-OST0001 00000020:00000080:0.0:1788746276.319973:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd47d1aa000 for lustre-OST0001 00010000:00010000:1.0:1788746276.346899:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746277.306874:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506304:0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.306906:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163506048:0@lo:400:kworker.0 00000100:00100000:3.0:1788746277.306909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163506176:0@lo:400:kworker.0 00000100:00100000:2.0:1788746277.307040:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163505920:0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.310211:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746277.310297:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163506560:0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.310341:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746277.311019:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506048 00000100:00100000:0.0:1788746277.311028:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506048 00000100:00100000:0.0:1788746277.311081:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788746277.311090:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163506048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.311154:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163506048:12345-0@lo:400:kworker.0 Request processed in 66us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.311161:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788746277.311255:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163506048:0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.311393:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506560 00000100:00100000:0.0:1788746277.311422:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506560 00000100:00100000:0.0:1788746277.311459:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788746277.311466:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163506560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.311504:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163506560:12345-0@lo:400:kworker.0 Request processed in 39us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.311510:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788746277.312957:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163506560:0@lo:400:kworker.0 00000100:00080000:0.0:1788746277.313106:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746277.315126:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746277.315815:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506304 00000100:00100000:0.0:1788746277.315826:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506304 00000100:00100000:0.0:1788746277.315907:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788746277.315917:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.315990:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506304:12345-0@lo:400:kworker.0 Request processed in 75us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.315997:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788746277.317800:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746277.317816:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788746277.317871:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45fb53b80 x1875636163506304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746277.317889:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506304:0@lo:400:kworker.0 00000100:00100000:2.0:1788746277.318013:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163506432:0@lo:400:kworker.0 00000100:00100000:2.0:1788746277.318068:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746277.318273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163505920 00000100:00100000:0.0:1788746277.318283:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163505920 00000100:00100000:0.0:1788746277.318350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788746277.318361:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163505920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.318452:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163505920:12345-0@lo:400:kworker.0 Request processed in 92us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.318460:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788746277.318478:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746277.318618:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163505920:0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.325800:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506432 00000100:00100000:0.0:1788746277.325821:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506432 00000100:00100000:0.0:1788746277.325933:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506176 00000100:00100000:0.0:1788746277.325937:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506176 00000100:00100000:0.0:1788746277.325996:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788746277.326008:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163506432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.326119:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163506432:12345-0@lo:400:kworker.0 Request processed in 113us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.326127:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788746277.326147:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788746277.326231:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163506176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746277.326270:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163506176:12345-0@lo:400:kworker.0 Request processed in 116us (7793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.326277:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788746277.326376:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746277.326458:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163506432:0@lo:400:kworker.0 00000100:00100000:3.0:1788746277.327576:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163506176:0@lo:400:kworker.0 00010000:00010000:3.0:1788746277.370663:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746277.821593:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746277.821626:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746277.821691:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746277.822394:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506688 00000100:00100000:0.0:1788746277.822424:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506688 00000100:00100000:0.0:1788746277.822477:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788746277.822486:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746277.822520:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746277.822580:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746277.822587:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788746277.822731:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788746278.394987:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746279.421352:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746279.450995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746279.451344:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450240 00000100:00100000:0.0:1788746279.451355:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450240 00000100:00100000:0.0:1788746279.451449:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 124 00000100:00100000:0.0:1788746279.451460:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141450240:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746279.451528:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141450240:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 70us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746279.451535:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 124 00000100:00080000:3.0:1788746279.452278:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746279.460804:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746279.461621:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746279.462938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450112 00000100:00100000:0.0:1788746279.462962:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450112 00000100:00100000:0.0:1788746279.463075:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 283 00000100:00100000:0.0:1788746279.463087:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141450112:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746279.463164:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141450112:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 80us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746279.463172:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 283 00000100:00100000:1.0:1788746279.467057:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450368 00000100:00100000:1.0:1788746279.467070:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450368 00000100:00100000:1.0:1788746279.467215:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 125 00000100:00100000:1.0:1788746279.467227:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141450368:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:3.0:1788746279.467271:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746279.467305:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141450368:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 81us (5686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746279.467313:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 125 00000040:00080000:3.0:1788746280.005168:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788746280.382028:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746280.382094:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746280.382481:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506816 00000100:00100000:2.0:1788746280.382489:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506816 00000100:00100000:2.0:1788746280.382560:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788746280.382571:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746280.382601:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746280.382649:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163506816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746280.382655:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788746280.382699:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f674700 x1875636163506816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746280.382717:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163506816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788746280.382918:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746280.442625:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746281.466549:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746282.426691:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163506944:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.426763:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.426836:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163507456:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.426865:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.426899:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788746282.426905:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163507072:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.426940:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.426975:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163507584:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427006:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.427037:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163507328:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427058:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.427073:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788746282.427078:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163507200:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427098:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746282.427126:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507456 00000100:00100000:2.0:1788746282.427134:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507456 00000100:00100000:2.0:1788746282.427185:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507072 00000100:00100000:2.0:1788746282.427189:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507072 00000100:00100000:2.0:1788746282.427203:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507200 00000100:00100000:2.0:1788746282.427205:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507200 00000100:00100000:2.0:1788746282.427221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788746282.427239:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427292:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163507456:12345-0@lo:400:kworker.0 Request processed in 63us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746282.427297:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788746282.427324:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788746282.427330:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427359:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163507072:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746282.427364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788746282.427379:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788746282.427393:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427452:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163507200:12345-0@lo:400:kworker.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746282.427458:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788746282.427492:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746282.427524:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163507200:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427556:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163507072:0@lo:400:kworker.0 00000100:00100000:2.0:1788746282.427566:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163507456:0@lo:400:kworker.0 00000100:00100000:0.0:1788746282.428145:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507584 00000100:00100000:0.0:1788746282.428152:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507584 00000100:00100000:0.0:1788746282.428192:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507328 00000100:00100000:0.0:1788746282.428195:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507328 00000100:00100000:0.0:1788746282.428218:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788746282.428235:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746282.428283:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163507584:12345-0@lo:400:kworker.0 Request processed in 58us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746282.428288:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788746282.428300:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788746282.428306:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746282.428339:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163507328:12345-0@lo:400:kworker.0 Request processed in 29us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746282.428345:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788746282.428370:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746282.428374:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788746282.428395:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f528700 x1875636163507328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746282.428430:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163507328:0@lo:400:kworker.0 00000100:00100000:0.0:1788746282.428469:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163507584:0@lo:400:kworker.0 00000100:00100000:1.0:1788746282.428727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163506944 00000100:00100000:1.0:1788746282.428732:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163506944 00000100:00100000:1.0:1788746282.428786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788746282.428795:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163506944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746282.428859:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163506944:12345-0@lo:400:kworker.0 Request processed in 65us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746282.428866:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788746282.430586:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163506944:0@lo:400:kworker.0 00000001:02000400:3.0:1788746282.490334:0:11839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:58:01 (1788746281) 00010000:00010000:3.0:1788746282.506735:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746282.938990:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746282.939073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746282.941188:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507712 00000100:00100000:1.0:1788746282.941204:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507712 00000100:00100000:1.0:1788746282.941270:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788746282.941281:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163507712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746282.941317:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746282.944694:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163507712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3406us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746282.944710:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788746282.949731:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163507712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746283.514851:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746284.499631:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746284.499942:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450496 00000100:00100000:2.0:1788746284.499951:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450496 00000100:00100000:2.0:1788746284.500033:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:2.0:1788746284.500044:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:10215:x1875636141450496:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746284.500062:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746284.500085:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b210 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500145:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500172:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500185:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746284.500217:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788746284.500220:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:0.0:1788746284.500486:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788746284.500587:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500610:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b210 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500625:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b210 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.500632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746284.500635:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746284.500638:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:2.0:1788746284.500696:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:10215:x1875636141450496:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 655us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746284.500704:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:0.0:1788746284.535423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746284.535532:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450624 00000100:00100000:2.0:1788746284.535542:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450624 00000100:00100000:2.0:1788746284.535601:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:2.0:1788746284.535610:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:10216:x1875636141450624:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746284.535629:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746284.535648:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b217 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535708:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535721:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535749:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535764:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535771:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.535777:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536002:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536011:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536019:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746284.536046:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788746284.536050:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746284.536066:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536075:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536081:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536096:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536102:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746284.536106:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536113:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536124:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746284.536127:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746284.536131:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536137:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309bc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536148:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536154:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536159:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536163:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746284.536166:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536182:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536190:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cd46e1ac500) 00010000:00010000:2.0:1788746284.536192:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746284.536195:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536200:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536360:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b217 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536376:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b217 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.536383:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd46e1ac900) 00010000:00010000:2.0:1788746284.536385:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746284.536387:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45400, rc 0) 00000100:00100000:2.0:1788746284.536503:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:10216:x1875636141450624:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 894us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746284.536512:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 33 00010000:00010000:1.0:1788746284.538747:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746284.552070:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746284.552169:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141450880 00000100:00100000:2.0:1788746284.552179:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141450880 00000100:00100000:2.0:1788746284.552245:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:2.0:1788746284.552256:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:10216:x1875636141450880:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746284.552288:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746284.552309:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b21e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552374:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552387:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552425:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552485:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552493:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552499:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552817:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b309bed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552827:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b309bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552835:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b309bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746284.552846:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788746284.552987:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.552995:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553002:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553008:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746284.553012:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553019:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553029:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd46e1ac900) 00010000:00010000:2.0:1788746284.553032:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746284.553037:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553043:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309bdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553056:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553062:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553067:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553081:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746284.553084:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553090:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553099:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cd46e1ac500) 00010000:00010000:2.0:1788746284.553101:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746284.553104:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553111:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309be6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553608:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309bd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b21e expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553625:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b309bed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b21e expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746284.553632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:2.0:1788746284.553634:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746284.553637:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44200, rc 0) 00000100:00100000:2.0:1788746284.553706:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10216:x1875636141450880:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 1452us (1644us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788746284.553714:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:1.0:1788746284.563779:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746284.563884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451008 00000100:00100000:2.0:1788746284.563906:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451008 00000100:00100000:2.0:1788746284.563972:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:2.0:1788746284.563983:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10216:x1875636141451008:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788746284.564096:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10216:x1875636141451008:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746284.564104:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:1.0:1788746284.567820:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746284.567878:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746284.568080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451264 00000100:00100000:0.0:1788746284.568080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451136 00000100:00100000:2.0:1788746284.568090:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451264 00000100:00100000:0.0:1788746284.568090:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451136 00000100:00100000:2.0:1788746284.568145:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 129 00000100:00100000:0.0:1788746284.568145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 285 00000100:00100000:2.0:1788746284.568155:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141451264:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746284.568155:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141451136:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746284.568483:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141451136:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 328us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746284.568492:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 285 00000100:00080000:1.0:1788746284.568752:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746284.573223:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141451264:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 5057us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746284.573730:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 129 00000040:00080000:0.0:1788746285.116017:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788746285.501194:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746285.501215:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163507840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746285.501279:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746285.503704:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163507840 00000100:00100000:2.0:1788746285.503718:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163507840 00000100:00100000:2.0:1788746285.503810:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746285.503821:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163507840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746285.503860:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746285.503943:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163507840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746285.503951:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788746285.504429:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788746285.504469:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f675880 x1875636163507840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746285.504491:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163507840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788746285.563493:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746286.149025:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1788746286.606116:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746287.148507:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.149044:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451392 00000100:00100000:3.0:1788746287.149055:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451392 00000100:00100000:3.0:1788746287.149126:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:3.0:1788746287.149137:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10258:x1875636141451392:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746287.149154:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746287.149172:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309bfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b225 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149242:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788746287.149260:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788746287.149266:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149277:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149295:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149302:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149308:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149498:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149506:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149513:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149519:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746287.149523:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149530:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149542:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746287.149551:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746287.149556:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149562:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309c02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149575:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149581:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149586:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149591:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746287.149595:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149600:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149606:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cd44773e400) 00010000:00010000:3.0:1788746287.149609:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746287.149611:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149616:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309c09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149644:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309bfb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b225 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149665:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746287.149668:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746287.149672:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309bfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b225 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.149681:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941e00, rc 0) 00000100:00100000:3.0:1788746287.149745:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10258:x1875636141451392:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 609us (1247us total) trans 0 rc 301/301 00000100:00100000:3.0:1788746287.149752:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:3.0:1788746287.159776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.159887:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451648 00000100:00100000:0.0:1788746287.159903:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451648 00000100:00100000:0.0:1788746287.159956:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:0.0:1788746287.159966:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10258:x1875636141451648:12345-192.168.206.24@tcp:36:lfs.0 00010000:00010000:0.0:1788746287.160018:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746287.160044:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309bb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b210 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160062:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746287.160073:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746287.160256:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160269:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160279:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160290:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160297:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.160304:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746287.161182:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788746287.161195:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161213:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161220:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161225:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746287.161229:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161236:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161248:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412c00) 00010000:00010000:0.0:1788746287.161250:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746287.161254:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.161260:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746287.161276:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000278eb511 reply state 000000008d2ea224 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746287.161283:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788746287.161386:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10258:x1875636141451648:12345-192.168.206.24@tcp:36:lfs.0 Request processed in 1419us (1617us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788746287.161394:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00010000:00010000:2.0:1788746287.167999:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168015:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168034:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168040:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746287.168045:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168052:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168066:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cd444412d00) 00010000:00010000:2.0:1788746287.168069:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746287.168073:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.168078:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309c17 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746287.296065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.296265:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451776 00000100:00100000:2.0:1788746287.296275:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451776 00000100:00100000:2.0:1788746287.296332:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:2.0:1788746287.296343:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10266:x1875636141451776:12345-192.168.206.24@tcp:101:lctl.0 00010000:00010000:2.0:1788746287.296366:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.296388:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b22c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296470:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296501:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296513:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746287.296551:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788746287.296555:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746287.296592:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296617:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b22c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296654:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b22c expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.296662:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:2.0:1788746287.296665:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746287.296668:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44e00, rc 0) 00000100:00100000:2.0:1788746287.296723:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10266:x1875636141451776:12345-192.168.206.24@tcp:101:lctl.0 Request processed in 382us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746287.296730:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:1.0:1788746287.390371:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.390530:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141451904 00000100:00100000:0.0:1788746287.390541:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141451904 00000100:00100000:0.0:1788746287.390612:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:0.0:1788746287.390623:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10272:x1875636141451904:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746287.390643:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746287.390664:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b233 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391170:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391185:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391197:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391210:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391217:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391223:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391310:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391319:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391326:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746287.391364:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788746287.391367:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746287.391559:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391573:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391579:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391586:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391592:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746287.391596:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391602:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391613:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:0.0:1788746287.391616:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746287.391681:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391690:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391847:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391866:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391873:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391879:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746287.391882:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391889:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391898:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cd444412c00) 00010000:00010000:0.0:1788746287.391900:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746287.391904:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391909:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309c3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391942:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309c2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b233 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.391956:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b233 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.394077:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:0.0:1788746287.394082:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788746287.394100:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8800, rc 0) 00000100:00100000:0.0:1788746287.394846:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:10272:x1875636141451904:12345-192.168.206.24@tcp:101:bash.0 Request processed in 4217us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.394857:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:3.0:1788746287.402845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.402979:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452160 00000100:00100000:2.0:1788746287.402988:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452160 00000100:00100000:2.0:1788746287.403044:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:2.0:1788746287.403054:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:10272:x1875636141452160:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746287.403073:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.403107:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b23a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403224:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403239:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403250:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403312:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.403328:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788746287.403928:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788746287.404097:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404108:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404116:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404147:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404165:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404172:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404178:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746287.404183:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404191:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404203:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746287.404206:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746287.404210:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404215:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309c4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746287.404227:0:5849:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f7c14f43 reply state 0000000027348320 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.404235:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788746287.404265:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404280:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.404299:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:2.0:1788746287.404301:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746287.404304:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746287.404372:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10272:x1875636141452160:12345-192.168.206.24@tcp:101:bash.0 Request processed in 1319us (1536us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788746287.404380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 40 00010000:00010000:0.0:1788746287.406317:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406333:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406341:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406347:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746287.406351:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406358:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406373:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746287.406377:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746287.406381:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.406387:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309c56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746287.408982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.409068:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452288 00000100:00100000:0.0:1788746287.409079:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452288 00000100:00100000:0.0:1788746287.409128:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:0.0:1788746287.409137:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875636141452288:12345-192.168.206.24@tcp:8:bash.0 00010000:00080000:0.0:1788746287.409180:0:8456:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:0.0:1788746287.409212:0:8456:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b309c6b 00002000:00100000:0.0:1788746287.409223:0:8456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 783b9179-e60a-4972-9e46-67c8ee44ca13/ffff9cd47d1cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788746287.409245:0:8456:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788746287.409874:0:8456:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788746287.409906:0:8456:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1c8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746287.410015:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141452288:12345-192.168.206.24@tcp:8:bash.0 Request processed in 877us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.410024:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:2.0:1788746287.420168:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.420244:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452416 00000100:00100000:0.0:1788746287.420253:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452416 00000100:00100000:0.0:1788746287.420323:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:0.0:1788746287.420333:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:0:x1875636141452416:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746287.420349:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746287.420369:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b241 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746287.420440:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746287.420460:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788746287.420464:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746287.420473:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.420492:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.420524:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8c00, rc 0) 00000100:00100000:0.0:1788746287.420571:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:0:x1875636141452416:12345-192.168.206.24@tcp:101:bash.0 Request processed in 239us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.420578:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00080000:1.0:1788746287.420690:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746287.424982:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.425155:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452544 00000100:00100000:0.0:1788746287.425165:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452544 00000100:00100000:0.0:1788746287.425224:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:0.0:1788746287.425234:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:10272:x1875636141452544:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746287.425251:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746287.425268:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b248 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.425299:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.425309:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746287.425313:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746287.425318:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.425373:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.425386:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746287.425443:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875636163507968:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746287.425532:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd345261480 going to sleep for 11 seconds 00000100:00100000:0.0:1788746287.437497:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875636163507968:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746287.437532:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.437552:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9c00, rc 0) 00000100:00100000:0.0:1788746287.437611:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10272:x1875636141452544:12345-192.168.206.24@tcp:101:bash.0 Request processed in 12377us (12636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.437619:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:3.0:1788746287.449147:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.449304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452672 00000100:00100000:1.0:1788746287.449314:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452672 00010000:00010000:1.0:1788746287.449353:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746287.449436:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:1.0:1788746287.449447:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141452672:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746287.449460:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746287.449482:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.449497:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.449522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b309c72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b241 expref: 8 pid: 6680 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.449539:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746287.449544:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746287.449566:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.449576:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.449614:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746287.449627:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875636163508096:192.168.206.24@tcp:105: 00000100:00100000:1.0:1788746287.449708:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746287.461128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.461226:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141452928 00000100:00100000:0.0:1788746287.461236:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141452928 00000100:00100000:0.0:1788746287.461294:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:0.0:1788746287.461304:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+12:10272:x1875636141452928:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:0.0:1788746287.461674:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10272:x1875636141452928:12345-192.168.206.24@tcp:35:bash.0 Request processed in 369us (551us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788746287.461682:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:2.0:1788746287.462209:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f553100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875636163508096:192.168.206.24@tcp:105: 00010000:00010000:2.0:1788746287.462228:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746287.462266:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141452672:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 12821us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746287.462274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:3.0:1788746287.547264:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746287.547287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163508480:0@lo:400:kworker.0 00000100:00100000:3.0:1788746287.547361:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746287.547476:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163508608:0@lo:400:kworker.0 00000100:00100000:3.0:1788746287.547505:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746287.547975:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508608 00000100:00100000:0.0:1788746287.547983:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508608 00000100:00100000:0.0:1788746287.548037:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788746287.548046:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163508608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746287.548104:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163508608:12345-0@lo:400:kworker.0 Request processed in 59us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.548122:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788746287.548143:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746287.548170:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163508608:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548456:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163508224:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548497:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746287.548536:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163508736:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548561:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746287.548580:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788746287.548586:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163508352:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548605:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746287.548621:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163508864:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548641:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746287.548664:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508480 00000100:00100000:1.0:1788746287.548669:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508480 00000100:00100000:1.0:1788746287.548718:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508736 00000100:00100000:1.0:1788746287.548722:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508736 00000100:00100000:1.0:1788746287.548737:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508352 00000100:00100000:1.0:1788746287.548739:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508352 00000100:00100000:1.0:1788746287.548790:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788746287.548798:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163508480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548839:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163508480:12345-0@lo:400:kworker.0 Request processed in 42us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.548845:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788746287.548859:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788746287.548864:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548895:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163508736:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.548902:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788746287.548913:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788746287.548919:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163508352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.548945:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163508352:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.548951:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788746287.549873:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746287.549920:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163508352:0@lo:400:kworker.0 00000100:00100000:1.0:1788746287.549934:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163508736:0@lo:400:kworker.0 00000100:00100000:2.0:1788746287.550563:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508864 00000100:00100000:2.0:1788746287.550570:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508864 00000100:00100000:2.0:1788746287.550619:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788746287.550627:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746287.550693:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163508864:12345-0@lo:400:kworker.0 Request processed in 67us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746287.550714:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788746287.550739:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746287.550761:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163508864:0@lo:400:kworker.0 00000100:00100000:0.0:1788746287.552890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163508224 00000100:00100000:0.0:1788746287.552904:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163508224 00000100:00100000:0.0:1788746287.552961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788746287.552971:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163508224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746287.553049:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd448589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163508224:12345-0@lo:400:kworker.0 Request processed in 79us (4550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.553061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788746287.553136:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163508480:0@lo:400:kworker.0 00000100:00100000:0.0:1788746287.558553:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4446d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163508224:0@lo:400:kworker.0 00000001:00100000:0.0:1788746287.594581:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000100:00100000:1.0:1788746287.598604:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.598892:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141453184 00000100:00100000:2.0:1788746287.598901:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141453184 00000100:00100000:2.0:1788746287.598956:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:2.0:1788746287.598966:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10282:x1875636141453184:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746287.599002:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.599024:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b24f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746287.599105:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788746287.599217:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b24f expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.599230:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:2.0:1788746287.599233:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746287.599238:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b24f expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.599251:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44000, rc 0) 00000100:00100000:2.0:1788746287.599311:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10282:x1875636141453184:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 346us (714us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788746287.599318:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:3.0:1788746287.601478:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.601593:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141453440 00000100:00100000:0.0:1788746287.601602:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141453440 00000100:00100000:0.0:1788746287.601675:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:0.0:1788746287.601684:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10282:x1875636141453440:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746287.602185:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10282:x1875636141453440:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 500us (712us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788746287.602193:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00010000:00010000:1.0:1788746287.610723:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746287.725963:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.726133:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141453568 00000100:00100000:2.0:1788746287.726142:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141453568 00000100:00100000:2.0:1788746287.726202:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:2.0:1788746287.726212:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10288:x1875636141453568:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746287.726235:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.726256:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b256 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726315:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726344:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726355:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746287.726389:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788746287.726392:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746287.726436:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726460:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309c8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b256 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726478:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b256 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.726486:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746287.726489:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746287.726492:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:2.0:1788746287.726549:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+16:10288:x1875636141453568:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 338us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746287.726556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:2.0:1788746287.744118:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.744223:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141453824 00000100:00100000:1.0:1788746287.744232:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141453824 00000100:00100000:1.0:1788746287.744289:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:1.0:1788746287.744299:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:10288:x1875636141453824:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746287.744319:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746287.744353:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309c9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b25d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.744488:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.744502:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.744514:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746287.744527:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788746287.744654:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309c9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b25d expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.744676:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b25d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.744684:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:1.0:1788746287.744687:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746287.744690:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400600, rc 0) 00000100:00100000:1.0:1788746287.744762:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+18:10288:x1875636141453824:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 455us (644us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788746287.744769:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:3.0:1788746287.750233:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.750281:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746287.750342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454208 00000100:00100000:0.0:1788746287.750352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454208 00000100:00100000:0.0:1788746287.750449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:0.0:1788746287.750461:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2349:x1875636141454208:12345-192.168.206.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788746287.750485:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454080 00000100:00100000:2.0:1788746287.750489:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454080 00010000:00010000:0.0:1788746287.750491:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746287.750515:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b25d expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.750519:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:2.0:1788746287.750525:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10288:x1875636141454080:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746287.750536:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:0.0:1788746287.750540:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746287.750549:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.750561:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309cb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b264 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746287.750585:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:2349:x1875636141454208:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.750592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00010000:00010000:2.0:1788746287.750652:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.750666:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.750676:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746287.750689:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788746287.750824:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b264 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.750839:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b264 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.750845:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:2.0:1788746287.750848:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788746287.750850:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45000, rc 0) 00000100:00100000:2.0:1788746287.750893:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10288:x1875636141454080:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 367us (669us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788746287.750900:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:0.0:1788746287.759514:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.759643:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454336 00000100:00100000:2.0:1788746287.759653:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454336 00000100:00100000:2.0:1788746287.759710:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:2.0:1788746287.759731:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141454336:12345-192.168.206.24@tcp:1:lfs.0 00010000:00010000:2.0:1788746287.759786:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.759805:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.759813:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788746287.759817:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746287.759822:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.759857:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.759871:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 6 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.759898:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875636163508992:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746287.759985:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788746287.770548:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.770639:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454464 00000100:00100000:3.0:1788746287.770648:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454464 00002000:00100000:3.0:1788746287.770702:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9cd47d379880 x1875636141454464/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:298/0 lens 504/0 e 0 to 0 dl 1788746298 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746287.770713:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd47d379880 with x1875636141454464 ext(0->12) 00010000:00010000:3.0:1788746287.770723:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 7 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.770739:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 7 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746287.770746:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd47d379880 00000100:00100000:2.0:1788746287.770767:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875636163508992:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746287.770795:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00010000:00010000:2.0:1788746287.770798:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746287.770804:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141454464:12345-192.168.206.24@tcp:4:lfs.0 00000100:00100000:3.0:1788746287.771611:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2349:x1875636141454464:12345-192.168.206.24@tcp:4:lfs.0 Request processed in 805us (1070us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788746287.771620:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00002000:00100000:3.0:1788746287.771628:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9cd47d379880 x1875636141454464/t4294967299(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:298/0 lens 504/448 e 0 to 0 dl 1788746298 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746287.771637:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd47d379880 with x1875636141454464 ext(0->12) 00010000:00010000:3.0:1788746287.771644:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.771658:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746287.771665:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd47d379880 00000100:00100000:0.0:1788746287.775720:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.775922:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454592 00000100:00100000:2.0:1788746287.775932:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454592 00010000:00010000:2.0:1788746287.775983:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.776087:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:2.0:1788746287.776097:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2347:x1875636141454592:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746287.776113:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788746287.776132:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788746287.776135:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788746288 00002000:00010000:2.0:1788746287.776137:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788746288 00002000:00010000:2.0:1788746287.776139:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788746288 00010000:00010000:2.0:1788746287.776145:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.776158:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.776180:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b309c79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b248 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.776196:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746287.776200:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746287.776205:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.776215:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.776275:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746287.776330:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2347:x1875636141454592:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 234us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746287.776337:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 36 00010000:00010000:0.0:1788746287.776423:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776433:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776456:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776465:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776473:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776500:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746287.776505:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776513:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776526:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746287.776533:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b309cc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746287.776579:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141454336:12345-192.168.206.24@tcp:1:lfs.0 Request processed in 16850us (17072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746287.776586:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:0.0:1788746287.779389:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.779461:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454848 00000100:00100000:2.0:1788746287.779471:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454848 00000100:00100000:2.0:1788746287.779525:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:2.0:1788746287.779534:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10288:x1875636141454848:12345-192.168.206.24@tcp:35:lfs.0 00000004:00010000:2.0:1788746287.779595:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b264 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746287.780120:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788746287.780170:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788746287.781175:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788746287.781340:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.781357:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.781365:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.781437:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.781452:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 23 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.781473:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875636163509120:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746287.781558:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788746287.785824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.785909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141454976 00000100:00100000:1.0:1788746287.785918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141454976 00010000:00010000:1.0:1788746287.785954:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 24 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746287.786021:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:1.0:1788746287.786030:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141454976:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746287.786045:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746287.786051:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 24 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.786063:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 24 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.786082:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:1.0:1788746287.786086:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.786095:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.786102:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.786119:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746287.786171:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141454976:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.786178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00010000:00010000:2.0:1788746287.787869:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309c5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b23a expref: 23 pid: 5849 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746287.787905:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875636163509120:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746287.787927:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.787936:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.787941:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746287.788061:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788746287.788670:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788746287.788793:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163509248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788746287.789052:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746287.789086:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746287.789465:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163509248 00000100:00100000:1.0:1788746287.789473:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163509248 00000100:00100000:1.0:1788746287.789516:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746287.789524:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163509248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788746287.789621:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163509248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.789630:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746287.789718:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163509248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788746287.790680:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788746287.790756:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163509376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788746287.790815:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746287.790846:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4584a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746287.791241:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163509376 00000100:00100000:1.0:1788746287.791247:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163509376 00000100:00100000:1.0:1788746287.791281:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746287.791289:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163509376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788746287.791504:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875636163509376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 214us (688us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788746287.791512:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746287.793477:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163509376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788746287.793565:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788746287.793793:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793805:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793812:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793818:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746287.793822:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793830:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793846:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746287.793849:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788746287.793853:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.793859:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309ccd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746287.794179:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788746287.795941:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788746287.795958:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362200558766ns, next at 363200555722ns, rc = 0 00000001:00080000:3.0:1788746287.795970:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788746287.796023:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746287.796027:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788746287.796036:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b309cb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b264 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746287.796157:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:10288:x1875636141454848:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 16623us (16774us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788746287.796166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000020:00080000:3.0:1788746287.796171:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788746287.799468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.799801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141455104 00000100:00100000:1.0:1788746287.799810:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141455104 00000100:00100000:1.0:1788746287.799859:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:1.0:1788746287.799867:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:10288:x1875636141455104:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746287.799901:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746287.799923:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309cd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b26b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.799977:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b26b expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.799990:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b26b expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.800009:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:1.0:1788746287.800012:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788746287.800029:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400400, rc 0) 00000100:00100000:1.0:1788746287.800089:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+27:10288:x1875636141455104:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 222us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.800097:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:0.0:1788746287.803273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.803355:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141455360 00000100:00100000:3.0:1788746287.803365:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141455360 00000100:00100000:3.0:1788746287.803437:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:3.0:1788746287.803448:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+27:10288:x1875636141455360:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746287.803810:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+28:10288:x1875636141455360:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 363us (544us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788746287.803818:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:0.0:1788746287.915512:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.915659:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141455616 00000100:00100000:2.0:1788746287.915669:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141455616 00000100:00100000:2.0:1788746287.915730:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:2.0:1788746287.915741:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+28:10298:x1875636141455616:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746287.915774:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746287.915804:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b272 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746287.916218:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788746287.916346:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309cdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b272 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.916359:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:2.0:1788746287.916362:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746287.916367:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b272 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746287.916381:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746287.916495:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10298:x1875636141455616:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 755us (991us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788746287.916503:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:0.0:1788746287.920769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.920865:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141455744 00000100:00100000:1.0:1788746287.920875:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141455744 00000100:00100000:1.0:1788746287.920948:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:1.0:1788746287.920958:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10298:x1875636141455744:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:1.0:1788746287.921031:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921046:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921058:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921073:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921080:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921087:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921170:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921178:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921198:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746287.921239:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921251:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921258:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921265:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921271:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746287.921275:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921283:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921295:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746287.921298:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746287.921302:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921308:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b309ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921324:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921338:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921343:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921348:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746287.921351:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921357:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921365:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd4511ad000) 00010000:00010000:1.0:1788746287.921367:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746287.921370:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921375:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921389:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921394:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921430:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921435:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746287.921444:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921451:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921459:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:1.0:1788746287.921462:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746287.921464:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.921470:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b309cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746287.921550:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10298:x1875636141455744:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 592us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.921557:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:1.0:1788746287.924698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746287.924797:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141456000 00000100:00100000:2.0:1788746287.924807:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141456000 00000100:00100000:2.0:1788746287.924858:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:2.0:1788746287.924868:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10298:x1875636141456000:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:2.0:1788746287.925103:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+30:10298:x1875636141456000:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 235us (412us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788746287.925111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:0.0:1788746287.967933:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.968020:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141456256 00000100:00100000:3.0:1788746287.968030:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141456256 00000100:00100000:3.0:1788746287.968136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:3.0:1788746287.968146:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+30:10301:x1875636141456256:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746287.968169:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746287.968201:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309cfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b279 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968271:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968364:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968375:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968390:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968420:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968428:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968533:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968542:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968550:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746287.968560:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788746287.968658:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968676:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968682:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968687:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746287.968692:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968699:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968711:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746287.968714:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746287.968719:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968725:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309d05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968739:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968745:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968750:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968756:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746287.968765:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968772:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968789:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773e400) 00010000:00010000:3.0:1788746287.968792:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746287.968795:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968801:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968843:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309cfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968857:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746287.968865:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:3.0:1788746287.968867:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746287.968870:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746287.969041:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+32:10301:x1875636141456256:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 896us (1116us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788746287.969050:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:0.0:1788746287.973989:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746287.974115:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141456384 00000100:00100000:1.0:1788746287.974124:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141456384 00000100:00100000:1.0:1788746287.974221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:1.0:1788746287.974242:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+32:10301:x1875636141456384:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746287.974304:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974320:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974331:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974374:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974382:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974389:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974395:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746287.974522:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974531:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974543:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:1.0:1788746287.974547:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746287.974551:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746287.974558:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b309d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746287.974630:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+32:10301:x1875636141456384:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 390us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746287.974638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:1.0:1788746287.977062:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746287.977160:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141456640 00000100:00100000:3.0:1788746287.977169:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141456640 00000100:00100000:3.0:1788746287.977223:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746287.977244:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+32:10301:x1875636141456640:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746287.977500:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+33:10301:x1875636141456640:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 257us (445us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788746287.977508:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746288.058704:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746288.058725:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746288.058814:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746288.059138:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163509504 00000100:00100000:2.0:1788746288.059146:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163509504 00000100:00100000:2.0:1788746288.059205:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788746288.059214:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163509504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746288.059246:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746288.059318:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746288.059325:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788746288.059546:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746288.308822:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746288.308932:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141456896 00000100:00100000:2.0:1788746288.308942:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141456896 00000100:00100000:2.0:1788746288.309003:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:2.0:1788746288.309015:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+33:10332:x1875636141456896:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:2.0:1788746288.309039:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746288.309059:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309d28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b280 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.309150:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.309163:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.309176:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746288.309187:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788746288.309325:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309d28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b280 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.309356:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b280 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.309364:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746288.309368:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746288.309384:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44c00, rc 0) 00000100:00100000:2.0:1788746288.309500:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10332:x1875636141456896:12345-192.168.206.24@tcp:101:cat.0 Request processed in 487us (685us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788746288.309508:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:1.0:1788746288.321529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746288.321737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141457152 00000100:00100000:3.0:1788746288.321757:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141457152 00000100:00100000:3.0:1788746288.321821:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:3.0:1788746288.321832:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10332:x1875636141457152:12345-192.168.206.24@tcp:35:cat.0 00000100:00100000:3.0:1788746288.322068:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+36:10332:x1875636141457152:12345-192.168.206.24@tcp:35:cat.0 Request processed in 237us (547us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788746288.322076:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:1.0:1788746288.331165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746288.331335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141457280 00000100:00100000:2.0:1788746288.331345:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141457280 00000100:00100000:2.0:1788746288.331438:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:2.0:1788746288.331448:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+36:2349:x1875636141457280:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746288.331463:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746288.331486:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b280 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.331503:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746288.331509:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746288.331564:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:2349:x1875636141457280:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 118us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746288.331572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:0.0:1788746288.406393:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746288.406503:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141457536 00000100:00100000:3.0:1788746288.406512:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141457536 00000100:00100000:3.0:1788746288.406585:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:3.0:1788746288.406596:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10338:x1875636141457536:12345-192.168.206.24@tcp:101:dd.0 00010000:00010000:3.0:1788746288.406694:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746288.406697:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788746288.406723:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b256 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.406740:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746288.406823:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746288.406931:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b287 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.407038:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.407052:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.407060:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.407092:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.407106:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 35 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746288.407119:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163509632:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746288.407394:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746288.418191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746288.418264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141457664 00000100:00100000:0.0:1788746288.418272:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141457664 00010000:00010000:0.0:1788746288.418305:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 36 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746288.418343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:0.0:1788746288.418352:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+36:2350:x1875636141457664:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746288.418365:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746288.418372:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 36 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746288.418383:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 36 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746288.418423:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:0.0:1788746288.418429:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746288.418438:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746288.418445:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746288.418466:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746288.418526:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+36:2350:x1875636141457664:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746288.418550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00010000:00010000:3.0:1788746288.424193:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b279 expref: 35 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746288.424215:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163509632:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746288.424238:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.424248:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.424273:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746288.424296:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788746288.424506:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 36 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.424521:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 35 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.424529:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:3.0:1788746288.424532:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788746288.424536:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940600, rc 0) 00000100:00100000:3.0:1788746288.424589:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10338:x1875636141457536:12345-192.168.206.24@tcp:101:dd.0 Request processed in 17994us (18204us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788746288.424597:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:1.0:1788746288.443149:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746288.443294:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141457920 00000100:00100000:3.0:1788746288.443305:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141457920 00000100:00100000:3.0:1788746288.443360:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:3.0:1788746288.443371:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10338:x1875636141457920:12345-192.168.206.24@tcp:36:dd.0 00010000:00010000:3.0:1788746288.443691:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.443708:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746288.443718:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746288.444066:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788746288.444094:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000edd08dcc reply state 000000008b3f5657 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746288.444102:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746288.444184:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+38:10338:x1875636141457920:12345-192.168.206.24@tcp:36:dd.0 Request processed in 814us (1043us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788746288.444192:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 52 00000020:00080000:3.0:1788746288.444197:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788746288.450184:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450200:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450208:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450214:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746288.450219:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450242:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450258:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746288.450261:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746288.450266:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.450272:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309d52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.636496:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746288.863704:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746288.863828:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141458048 00000100:00100000:2.0:1788746288.863846:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141458048 00000100:00100000:2.0:1788746288.863904:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:2.0:1788746288.863914:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+37:10353:x1875636141458048:12345-192.168.206.24@tcp:101:stat.0 00010000:00010000:2.0:1788746288.863936:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746288.863955:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b28e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864013:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864026:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864037:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864051:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864073:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864081:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864164:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864175:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 38 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864184:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864212:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 38 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.864241:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 38 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746288.864255:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f676300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163509760:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746288.864474:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746288.878376:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f676300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163509760:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746288.878434:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746288.878526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746288.878931:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141458304 00000100:00100000:0.0:1788746288.878938:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141458304 00000100:00100000:0.0:1788746288.878982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746288.878991:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+39:5587:x1875636141458304:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788746288.879317:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+40:5587:x1875636141458304:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 324us (789us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788746288.879325:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746288.882509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746288.883424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141458432 00000100:00100000:2.0:1788746288.883451:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141458432 00010000:00010000:2.0:1788746288.883498:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 40 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746288.883541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:2.0:1788746288.883550:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+40:2350:x1875636141458432:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746288.883564:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746288.883570:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 40 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883582:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 40 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883602:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309d44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b287 expref: 40 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883619:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746288.883624:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883633:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883641:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746288.883676:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746288.883755:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+39:2350:x1875636141458432:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 199us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746288.883780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00010000:00010000:1.0:1788746288.885119:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885132:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746288.885177:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788746288.885182:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746288.885236:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885251:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885260:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885267:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885284:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885290:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746288.885294:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885301:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885326:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746288.885329:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746288.885334:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885340:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b309d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885354:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885360:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885366:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885371:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746288.885374:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885380:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885388:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ace00) 00010000:00010000:1.0:1788746288.885390:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746288.885393:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885446:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b309d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885494:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b309d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b28e expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885508:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b28e expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746288.885515:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:1.0:1788746288.885517:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746288.885520:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:1.0:1788746288.885573:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+38:10353:x1875636141458048:12345-192.168.206.24@tcp:101:stat.0 Request processed in 21660us (21887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746288.885582:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:0.0:1788746289.008690:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.008956:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141458688 00000100:00100000:3.0:1788746289.008965:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141458688 00000100:00100000:3.0:1788746289.009030:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 54 00000100:00100000:3.0:1788746289.009040:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+38:10359:x1875636141458688:12345-192.168.206.24@tcp:36:truncate.0 00010000:00010000:3.0:1788746289.009089:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746289.009111:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309d6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b28e expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.009127:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:3.0:1788746289.009131:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788746289.009280:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788746289.009459:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.009472:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.009481:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746289.009525:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788746289.009563:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009f9097bf reply state 0000000012e547c5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746289.009571:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746289.010122:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+40:10359:x1875636141458688:12345-192.168.206.24@tcp:36:truncate.0 Request processed in 1082us (1438us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788746289.010129:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 54 00000020:00080000:3.0:1788746289.010134:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788746289.014223:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014238:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014253:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014258:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746289.014262:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014269:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014282:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:3.0:1788746289.014285:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746289.014289:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.014294:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746289.158444:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.163943:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141458816 00000100:00100000:3.0:1788746289.163967:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141458816 00000100:00100000:2.0:1788746289.164115:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:2.0:1788746289.164125:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+39:10373:x1875636141458816:12345-192.168.206.24@tcp:101:stat.0 00010000:00010000:2.0:1788746289.164148:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746289.164166:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b295 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164237:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164249:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164258:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164271:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164278:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164284:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164359:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164366:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.164380:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746289.164432:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788746289.164436:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746289.165061:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165078:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165086:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165092:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165098:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165104:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.165107:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165114:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165124:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746289.165127:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.165131:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165146:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165158:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165163:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165168:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165173:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.165175:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165181:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165188:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746289.165190:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.165193:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165198:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165232:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 41 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165245:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 40 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.165259:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.165262:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746289.165265:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746289.165333:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+40:10373:x1875636141458816:12345-192.168.206.24@tcp:101:stat.0 Request processed in 1209us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746289.165342:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:0.0:1788746289.301135:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.301316:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141459072 00000100:00100000:3.0:1788746289.301325:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141459072 00000100:00100000:3.0:1788746289.301375:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00100000:3.0:1788746289.301383:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+40:10383:x1875636141459072:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746289.301436:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746289.301455:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b29c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746289.301527:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788746289.301624:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b29c expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.301638:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:3.0:1788746289.301641:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746289.301646:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b29c expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.301658:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746289.301702:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+41:10383:x1875636141459072:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 320us (576us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788746289.301709:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00100000:1.0:1788746289.304912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.305000:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141459328 00000100:00100000:0.0:1788746289.305008:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141459328 00000100:00100000:0.0:1788746289.305064:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:0.0:1788746289.305073:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+41:10383:x1875636141459328:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746289.305272:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+42:10383:x1875636141459328:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 199us (368us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788746289.305279:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:1.0:1788746289.415124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.415323:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141459584 00000100:00100000:2.0:1788746289.415333:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141459584 00000100:00100000:2.0:1788746289.415392:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:2.0:1788746289.415430:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+42:10389:x1875636141459584:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746289.415454:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746289.415475:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309da6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2a3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.415577:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.415592:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 43 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.415601:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.415643:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 43 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.415657:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 43 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746289.415686:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f676300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163509888:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746289.415902:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746289.424474:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f676300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163509888:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746289.424502:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746289.426020:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.426536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141459712 00000100:00100000:0.0:1788746289.426546:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141459712 00010000:00010000:0.0:1788746289.426583:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 44 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746289.426623:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:0.0:1788746289.426642:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+44:2350:x1875636141459712:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746289.426669:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746289.426676:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 44 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426689:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 44 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426709:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309d91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b295 expref: 44 pid: 8618 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426725:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:0.0:1788746289.426731:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426750:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426758:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.426803:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746289.426859:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+43:2350:x1875636141459712:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 226us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746289.426866:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 40 00010000:00010000:2.0:1788746289.427158:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.427167:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746289.427186:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788746289.427318:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309da6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.427333:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.427341:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.427344:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746289.427346:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45600, rc 0) 00000100:00100000:2.0:1788746289.427386:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+43:10389:x1875636141459584:12345-192.168.206.24@tcp:101:bash.0 Request processed in 11959us (12271us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788746289.427393:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:1.0:1788746289.434729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.434916:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141459968 00000100:00100000:3.0:1788746289.434926:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141459968 00000100:00100000:3.0:1788746289.434984:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:3.0:1788746289.434993:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+43:10389:x1875636141459968:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:3.0:1788746289.435253:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.435282:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.435295:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746289.435362:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788746289.435387:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000ce6346b reply state 0000000073d7fcfb transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746289.435435:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746289.435522:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+46:10389:x1875636141459968:12345-192.168.206.24@tcp:36:bash.0 Request processed in 529us (799us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788746289.435530:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 58 00000020:00080000:3.0:1788746289.435534:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788746289.439365:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439383:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439391:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439452:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.439457:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439465:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439482:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.439485:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.439490:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.439497:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309dbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746289.443823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.443902:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141460096 00000100:00100000:2.0:1788746289.443912:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141460096 00000100:00100000:2.0:1788746289.443967:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:2.0:1788746289.443977:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+45:10389:x1875636141460096:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746289.443999:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746289.444018:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2aa expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.444095:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.444109:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.444146:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.444178:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.444192:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 46 pid: 5850 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746289.444205:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163510016:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746289.444278:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746289.447422:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163510016:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746289.447448:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746289.452202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.452477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141460224 00000100:00100000:2.0:1788746289.452486:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141460224 00010000:00010000:2.0:1788746289.452526:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 47 pid: 5850 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746289.452570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:2.0:1788746289.452580:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+47:2349:x1875636141460224:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746289.452594:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746289.452600:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 47 pid: 5850 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452631:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 47 pid: 5850 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452652:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2a3 expref: 47 pid: 5850 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452668:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.452673:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452687:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452696:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.452728:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746289.452799:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+46:2349:x1875636141460224:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 220us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746289.452806:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 41 00010000:00010000:1.0:1788746289.453183:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746289.453196:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746289.453254:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788746289.453259:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746289.453282:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746289.453313:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2aa expref: 46 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746289.453327:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2aa expref: 45 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746289.453393:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:1.0:1788746289.453445:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746289.453448:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:1.0:1788746289.453496:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+45:10389:x1875636141460096:12345-192.168.206.24@tcp:101:bash.0 Request processed in 9520us (9681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746289.453503:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:1.0:1788746289.467988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.468054:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141460480 00000100:00100000:0.0:1788746289.468064:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141460480 00000100:00100000:0.0:1788746289.468118:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:0.0:1788746289.468138:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+45:10389:x1875636141460480:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:0.0:1788746289.468599:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+46:10389:x1875636141460480:12345-192.168.206.24@tcp:35:bash.0 Request processed in 470us (617us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788746289.468679:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:3.0:1788746289.592967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.593094:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141460736 00000100:00100000:0.0:1788746289.593104:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141460736 00000100:00100000:0.0:1788746289.593166:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:0.0:1788746289.593177:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+46:10399:x1875636141460736:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746289.593202:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746289.593222:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b309dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746289.593314:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788746289.593445:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b309dd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2b1 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.593460:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:0.0:1788746289.593463:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746289.593468:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b309dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2b1 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.593481:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8000, rc 0) 00000100:00100000:0.0:1788746289.593543:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10399:x1875636141460736:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 368us (584us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788746289.593551:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:1.0:1788746289.597724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.597840:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141460864 00000100:00100000:2.0:1788746289.597850:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141460864 00000100:00100000:2.0:1788746289.597912:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:2.0:1788746289.597922:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10399:x1875636141460864:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:2.0:1788746289.597992:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598009:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598032:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598048:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598056:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598062:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598139:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598149:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598155:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746289.598191:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598201:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598208:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598215:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598229:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.598233:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598240:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598252:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746289.598255:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.598260:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598266:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309dde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598280:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598285:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598291:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598295:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.598298:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598303:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598319:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746289.598321:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.598324:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598330:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598358:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598364:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598369:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598373:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.598376:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598381:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598387:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.598390:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.598393:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.598442:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746289.598517:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10399:x1875636141460864:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 595us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746289.598525:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:1.0:1788746289.624685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.624799:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461120 00000100:00100000:0.0:1788746289.624807:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461120 00000100:00100000:0.0:1788746289.624860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:0.0:1788746289.624892:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10399:x1875636141461120:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746289.625105:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10399:x1875636141461120:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 224us (427us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788746289.625112:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00010000:00010000:3.0:1788746289.658623:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746289.679558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.679705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461376 00000100:00100000:2.0:1788746289.679716:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461376 00000100:00100000:2.0:1788746289.679792:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00100000:2.0:1788746289.679803:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10402:x1875636141461376:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746289.679829:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746289.679848:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309df3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679914:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679927:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679938:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679951:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679958:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.679965:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680077:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680085:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680092:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746289.680102:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788746289.680187:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680195:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680201:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680207:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.680211:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680217:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680228:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746289.680231:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.680235:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680251:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b309dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680265:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680271:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680277:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680281:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746289.680284:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680290:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680298:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746289.680301:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746289.680303:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680309:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680494:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309df3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2b8 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680511:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2b8 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.680524:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.680526:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746289.680529:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44600, rc 0) 00000100:00100000:2.0:1788746289.680590:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10402:x1875636141461376:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 789us (1039us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788746289.680598:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00100000:1.0:1788746289.684032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746289.684103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.684176:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461632 00000100:00100000:0.0:1788746289.684185:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461632 00000100:00100000:0.0:1788746289.684254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:0.0:1788746289.684264:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+50:2347:x1875636141461632:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746289.684278:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746289.684298:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b309e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2b8 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.684315:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:0.0:1788746289.684319:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746289.684367:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+49:2347:x1875636141461632:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746289.684374:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:1.0:1788746289.686627:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746289.686673:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746289.686704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.686742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461760 00000100:00100000:0.0:1788746289.686761:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461760 00000100:00100000:0.0:1788746289.686808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 287 00000100:00100000:0.0:1788746289.686817:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141461760:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746289.686874:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44858b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141461760:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746289.686890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 287 00000100:00100000:3.0:1788746289.687053:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461888 00000100:00100000:3.0:1788746289.687058:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461888 00000100:00100000:3.0:1788746289.687105:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:3.0:1788746289.687114:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141461888:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:0.0:1788746289.687180:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746289.687251:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141461888:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 137us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746289.687258:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:2.0:1788746289.689258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141461504 00000100:00100000:2.0:1788746289.689272:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141461504 00000100:00100000:0.0:1788746289.689328:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141462016 00000100:00100000:0.0:1788746289.689334:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141462016 00000100:00100000:2.0:1788746289.689462:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:2.0:1788746289.689474:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+49:10402:x1875636141461504:12345-192.168.206.24@tcp:54:lfs.0 00000100:00080000:1.0:1788746289.689525:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746289.689609:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 133 00010000:00010000:2.0:1788746289.689610:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746289.689621:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141462016:12345-192.168.206.24@tcp:400:kworker.0 00010000:00010000:2.0:1788746289.689632:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689646:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689671:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689679:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689687:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746289.689693:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141462016:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 74us (2985us total) trans 0 rc 0/0 00010000:00010000:2.0:1788746289.689697:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00000100:00100000:0.0:1788746289.689703:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 133 00010000:00010000:2.0:1788746289.689715:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689875:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689888:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.689891:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746289.689896:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.689902:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746289.689955:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+49:10402:x1875636141461504:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 484us (5930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746289.689970:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:1.0:1788746289.692634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.692733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141462272 00000100:00100000:0.0:1788746289.692815:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141462272 00000100:00100000:0.0:1788746289.692950:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:0.0:1788746289.692961:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+49:10402:x1875636141462272:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746289.693182:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10402:x1875636141462272:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 222us (849us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788746289.693188:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:1.0:1788746289.844361:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.844481:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141462528 00000100:00100000:3.0:1788746289.844492:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141462528 00000100:00100000:3.0:1788746289.844565:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:3.0:1788746289.844589:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10419:x1875636141462528:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:3.0:1788746289.844614:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746289.844634:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.844756:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309e24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.844780:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309e24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.844791:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309e24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746289.844803:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788746289.845000:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2bf expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.845019:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309e24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2bf expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.845026:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:3.0:1788746289.845029:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788746289.845032:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941e00, rc 0) 00000100:00100000:3.0:1788746289.845147:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10419:x1875636141462528:12345-192.168.206.24@tcp:101:cat.0 Request processed in 559us (793us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788746289.845155:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:1.0:1788746289.891224:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.891846:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141462656 00000100:00100000:0.0:1788746289.891857:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141462656 00000100:00100000:0.0:1788746289.891926:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:0.0:1788746289.891936:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10421:x1875636141462656:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746289.891958:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746289.891977:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b309e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2c6 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892038:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892051:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892079:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746289.892112:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788746289.892115:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746289.892130:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892153:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b309e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2c6 expref: 54 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892172:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2c6 expref: 53 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.892180:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:0.0:1788746289.892182:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746289.892186:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9c00, rc 0) 00000100:00100000:0.0:1788746289.892257:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10421:x1875636141462656:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 322us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746289.892264:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:1.0:1788746289.903129:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.903214:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463040 00000100:00100000:3.0:1788746289.903224:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463040 00000100:00100000:3.0:1788746289.903308:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:3.0:1788746289.903317:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10421:x1875636141463040:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746289.903642:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10421:x1875636141463040:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 324us (519us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788746289.903649:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:1.0:1788746289.913911:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746289.916175:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463168 00000100:00100000:2.0:1788746289.916189:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463168 00000100:00100000:2.0:1788746289.916277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:2.0:1788746289.916288:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10421:x1875636141463168:12345-192.168.206.24@tcp:103:lfs.0 00010000:00010000:2.0:1788746289.916303:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788746289.916326:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2aa expref: 54 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.916349:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309e24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2bf expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.916363:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309cd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b26b expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746289.916393:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad400) 00010000:00010000:2.0:1788746289.916503:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746289.916573:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10421:x1875636141463168:12345-192.168.206.24@tcp:103:lfs.0 Request processed in 287us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746289.916581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:1.0:1788746289.921137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746289.921237:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463296 00000100:00100000:3.0:1788746289.921246:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463296 00000100:00100000:3.0:1788746289.921358:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:3.0:1788746289.921369:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10421:x1875636141463296:12345-192.168.206.24@tcp:58:lfs.0 00010000:00010000:3.0:1788746289.921512:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.921527:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746289.921539:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746289.922026:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746289.922241:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788746289.922307:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788746289.922439:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10421:x1875636141463296:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 1071us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746289.922448:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:1.0:1788746289.943725:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746289.944001:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463424 00000100:00100000:0.0:1788746289.944010:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463424 00000100:00100000:0.0:1788746289.944120:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 67 00000100:00100000:0.0:1788746289.944131:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10423:x1875636141463424:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746289.944151:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746289.944172:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b309e47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2cd expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944270:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944284:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944294:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944309:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944315:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944322:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944436:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944445:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944452:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746289.944485:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788746289.944489:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746289.944505:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944527:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944535:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944540:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944558:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944564:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746289.944567:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944574:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944585:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:0.0:1788746289.944588:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746289.944592:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944598:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944611:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944617:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944629:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944634:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746289.944636:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944642:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944649:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd444412c00) 00010000:00010000:0.0:1788746289.944652:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746289.944655:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944660:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944688:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b309e47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 53 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944699:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 52 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746289.944706:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:0.0:1788746289.944708:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746289.944710:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9a00, rc 0) 00000100:00100000:0.0:1788746289.945121:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10423:x1875636141463424:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 991us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746289.945138:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 67 00000040:00080000:2.0:1788746290.234831:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746290.234840:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746290.234903:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788746290.234910:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788746290.235025:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f675c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163510144:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788746290.235113:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746290.247942:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.248162:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f675c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163510144:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788746290.249326:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463552 00000100:00100000:3.0:1788746290.249337:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463552 00000100:00100000:3.0:1788746290.249437:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:3.0:1788746290.249448:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463552:12345-192.168.206.24@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788746290.249527:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463552:12345-192.168.206.24@tcp:900:lhsmtool_posix.0 Request processed in 82us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.249534:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:1.0:1788746290.255072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.255177:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463680 00000100:00100000:0.0:1788746290.255187:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463680 00000100:00100000:0.0:1788746290.255252:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:0.0:1788746290.255263:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463680:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788746290.255292:0:5851:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788746290.255458:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463680:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 197us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746290.255466:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:1.0:1788746290.274914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.275009:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141463808 00000100:00100000:2.0:1788746290.275018:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141463808 00000100:00100000:2.0:1788746290.275076:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:2.0:1788746290.275086:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463808:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.275162:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275179:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275190:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275205:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275224:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275232:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275258:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275266:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275272:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746290.275305:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788746290.275308:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746290.275320:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275329:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275334:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275340:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275345:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.275349:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275361:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275372:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:2.0:1788746290.275375:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.275380:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275385:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309e63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275448:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275456:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275462:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275467:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.275469:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275475:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275482:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746290.275484:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.275487:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275502:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309e6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275516:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275521:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275526:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275531:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.275534:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275540:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275547:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:2.0:1788746290.275549:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.275552:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.275558:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.275630:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141463808:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 Request processed in 546us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746290.275638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:1.0:1788746290.304502:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.304583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141464064 00000100:00100000:0.0:1788746290.304592:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141464064 00000100:00100000:0.0:1788746290.304649:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:0.0:1788746290.304659:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10434:x1875636141464064:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746290.304677:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746290.304697:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304803:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304818:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304830:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746290.304842:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788746290.304959:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304967:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304972:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304978:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746290.304982:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.304989:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.305000:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:0.0:1788746290.305003:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746290.305008:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.305014:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b309e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.305058:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2d4 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.305067:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:0.0:1788746290.305069:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746290.305073:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b309e78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2d4 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.305094:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8600, rc 0) 00000100:00100000:0.0:1788746290.305160:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464064:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 502us (666us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788746290.305167:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:1.0:1788746290.322144:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.322225:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141464192 00000100:00100000:3.0:1788746290.322235:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141464192 00000100:00100000:3.0:1788746290.322289:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 71 00000100:00100000:3.0:1788746290.322299:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464192:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788746290.322345:0:5850:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788746290.322465:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464192:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 167us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.322472:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 71 00000100:00100000:0.0:1788746290.327747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.327864:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141464448 00000100:00100000:3.0:1788746290.327874:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141464448 00000100:00100000:3.0:1788746290.327988:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 72 00000100:00100000:3.0:1788746290.328001:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464448:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746290.328022:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746290.328026:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788746290.328052:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b309e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2c6 expref: 53 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328069:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746290.328073:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746290.328087:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309e8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746290.328502:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788746290.328699:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328712:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328722:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328786:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309e8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2db expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328801:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2db expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.328810:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd44773ef00) 00010000:00010000:3.0:1788746290.328812:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746290.328815:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746290.328866:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10434:x1875636141464448:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 869us (1134us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788746290.328874:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 72 00000100:00100000:1.0:1788746290.332714:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.332802:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141464704 00000100:00100000:2.0:1788746290.332812:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141464704 00000100:00100000:2.0:1788746290.332872:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:2.0:1788746290.332881:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10434:x1875636141464704:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.333653:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746290.333682:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2db expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333701:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd44773ef00) 00010000:00010000:2.0:1788746290.333713:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746290.333736:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333749:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333759:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333783:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333791:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333798:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333852:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333874:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333893:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333899:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.333904:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333911:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.333919:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746290.333922:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.334159:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334167:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b309ea2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334179:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334185:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334212:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334218:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.334237:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334244:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334252:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb95115d8 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746290.334255:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.334258:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.334264:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b309ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb95115d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.334366:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464704:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 1485us (1660us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746290.334375:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:2.0:1788746290.353968:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.354008:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141464832 00000100:00100000:2.0:1788746290.354017:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141464832 00000100:00100000:2.0:1788746290.354066:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 74 00000100:00100000:2.0:1788746290.354075:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10434:x1875636141464832:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.354093:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746290.354117:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309eb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354152:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354165:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354189:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354274:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309eb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354292:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.354300:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746290.354303:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746290.354307:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45600, rc 0) 00000100:00100000:2.0:1788746290.354360:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10434:x1875636141464832:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 285us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746290.354367:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 74 00000100:00100000:1.0:1788746290.364444:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746290.364482:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465088 00000100:00100000:1.0:1788746290.364490:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465088 00000100:00100000:1.0:1788746290.364539:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:1.0:1788746290.364549:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10434:x1875636141465088:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788746290.364622:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.364639:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.364651:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746290.365123:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788746290.365134:0:8618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364769735184ns, next at 365769731862ns, rc = 0 00000004:00010000:1.0:1788746290.365225:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b00db952 reply state 00000000e62a4beb transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.365240:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788746290.365340:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10434:x1875636141465088:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 790us (902us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788746290.365348:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 75 00010000:00010000:1.0:1788746290.368638:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368655:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368662:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368668:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746290.368674:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368681:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368696:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:1.0:1788746290.368699:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746290.368703:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.368708:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b309ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.376143:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.376489:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465216 00000100:00100000:3.0:1788746290.376500:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465216 00000100:00100000:3.0:1788746290.376560:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 76 00000100:00100000:3.0:1788746290.376571:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10434:x1875636141465216:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746290.376595:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746290.376617:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.376697:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.376712:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.376729:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746290.376732:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746290.376752:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941c00, rc 0) 00000100:00100000:3.0:1788746290.376828:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10434:x1875636141465216:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 258us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.376835:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 76 00000100:00100000:3.0:1788746290.380028:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.380180:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465344 00000100:00100000:0.0:1788746290.380190:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465344 00000100:00100000:0.0:1788746290.380235:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:0.0:1788746290.380243:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875636141465344:12345-192.168.206.24@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788746290.380272:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:0.0:1788746290.380302:0:6682:0:(genops.c:1384:class_connect()) connect: client 783b9179-e60a-4972-9e46-67c8ee44ca13, cookie 0xe59b64da5b309ecc 00002000:00100000:0.0:1788746290.380313:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 783b9179-e60a-4972-9e46-67c8ee44ca13/ffff9cd47d1ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788746290.380334:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788746290.380570:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788746290.380596:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746290.380654:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2346:x1875636141465344:12345-192.168.206.24@tcp:8:lhsmtool_posix.0 Request processed in 410us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746290.380661:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:0.0:1788746290.385697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.386112:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465472 00000100:00100000:2.0:1788746290.386122:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465472 00000100:00100000:2.0:1788746290.386182:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:2.0:1788746290.386192:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:0:x1875636141465472:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788746290.386559:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788746290.442544:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000001:00080000:1.0:1788746290.442562:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1788746290.442731:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:0:x1875636141465472:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 56536us (57036us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788746290.442752:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:1.0:1788746290.445069:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.445163:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465728 00000100:00100000:2.0:1788746290.445173:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465728 00000100:00100000:2.0:1788746290.445232:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:2.0:1788746290.445241:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10434:x1875636141465728:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788746290.445485:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10434:x1875636141465728:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 243us (423us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788746290.445508:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746290.447642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.447730:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141465984 00000100:00100000:2.0:1788746290.447748:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141465984 00000100:00100000:2.0:1788746290.447814:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:2.0:1788746290.447824:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10434:x1875636141465984:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788746290.447934:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10434:x1875636141465984:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746290.447941:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:1.0:1788746290.450463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.450547:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466112 00000100:00100000:3.0:1788746290.450556:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466112 00000100:00100000:3.0:1788746290.450604:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:3.0:1788746290.450614:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10434:x1875636141466112:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746290.450632:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746290.450650:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450719:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450734:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450779:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746290.450815:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746290.450832:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450857:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f0 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450873:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f0 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.450891:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746290.450894:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788746290.450897:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746290.450949:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10434:x1875636141466112:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 335us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.450955:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:3.0:1788746290.454019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.454143:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466240 00000100:00100000:0.0:1788746290.454163:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466240 00000100:00100000:0.0:1788746290.454220:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:0.0:1788746290.454230:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2350:x1875636141466240:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746290.454245:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746290.454265:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2f7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746290.454288:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1a33, blocks: 0x1 00010000:00010000:0.0:1788746290.454316:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788746290.454321:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746290.454329:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.454349:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.454361:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8600, rc 0) 00000100:00100000:0.0:1788746290.454438:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141466240:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 209us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746290.454445:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:2.0:1788746290.456896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.456964:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466496 00000100:00100000:3.0:1788746290.456972:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466496 00000100:00100000:3.0:1788746290.457027:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:3.0:1788746290.457037:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10434:x1875636141466496:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788746290.457136:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10434:x1875636141466496:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.457143:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:1.0:1788746290.462798:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.462964:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466624 00000100:00100000:2.0:1788746290.462973:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466624 00000100:00100000:2.0:1788746290.463028:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:2.0:1788746290.463039:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:10434:x1875636141466624:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.463056:0:8456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746290.463076:0:8456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b2fe expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.463107:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.463117:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746290.463121:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746290.463127:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.463167:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.463180:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.463194:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163510272:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746290.463276:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788746290.468804:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163510272:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746290.468837:0:8456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.468855:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:2.0:1788746290.468858:0:8456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:1.0:1788746290.468887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466752 00000100:00100000:1.0:1788746290.468894:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466752 00000100:00100000:2.0:1788746290.468923:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10434:x1875636141466624:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 5886us (6135us total) trans 0 rc 0/0 00010000:00010000:1.0:1788746290.468923:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 8 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.468932:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:1.0:1788746290.468950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:1.0:1788746290.468958:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141466752:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746290.468970:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746290.468990:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.469001:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.469021:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067665ff1/0xe59b64da5b309ee1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f7 expref: 7 pid: 6682 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.469032:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746290.469037:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746290.469045:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.469063:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.469091:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.469104:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875636163510400:192.168.206.24@tcp:105: 00000100:00100000:1.0:1788746290.469159:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44579a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746290.479127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.479221:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875636163510400:192.168.206.24@tcp:105: 00010000:00010000:0.0:1788746290.479245:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746290.479305:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141466752:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 10347us (10583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746290.479316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:3.0:1788746290.480272:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141466880 00000100:00100000:3.0:1788746290.480281:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141466880 00002000:00100000:3.0:1788746290.480322:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cd47d0f3480 x1875636141466880/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:301/0 lens 504/0 e 0 to 0 dl 1788746301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746290.480332:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd47d0f3480 with x1875636141466880 ext(0->8) 00002000:00010000:3.0:1788746290.480338:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd47d0f3480 00000100:00100000:3.0:1788746290.480377:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:3.0:1788746290.480413:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141466880:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788746290.482258:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141466880:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 Request processed in 1856us (3132us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788746290.482272:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00002000:00100000:3.0:1788746290.482283:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cd47d0f3480 x1875636141466880/t4294967302(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:301/0 lens 504/448 e 0 to 0 dl 1788746301 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746290.482293:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd47d0f3480 with x1875636141466880 ext(0->8) 00002000:00010000:3.0:1788746290.482299:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd47d0f3480 00000100:00100000:1.0:1788746290.487143:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.487291:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467008 00000100:00100000:3.0:1788746290.487301:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467008 00000100:00100000:3.0:1788746290.487388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:3.0:1788746290.487426:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10434:x1875636141467008:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788746290.531795:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1788746290.531841:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788746290.531846:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1788746290.532190:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10434:x1875636141467008:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 Request processed in 44788us (45052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.532201:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:3.0:1788746290.534370:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.534466:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467136 00000100:00100000:2.0:1788746290.534475:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467136 00000100:00100000:2.0:1788746290.534527:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:2.0:1788746290.534536:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141467136:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788746290.536258:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788746290.536319:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788746290.536338:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd345261480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788746290.536342:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd448c7ad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd345261f00 00000020:00080000:0.0:1788746290.536346:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd448c7a000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd4460a4000 00000020:00080000:1.0:1788746290.536544:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788746290.536655:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788746290.536665:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746290.536682:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163510528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788746290.536755:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746290.536820:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163510528 00000100:00100000:1.0:1788746290.536828:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163510528 00000100:00100000:1.0:1788746290.536876:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746290.537007:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163510528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788746290.537136:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788746290.537140:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788746291 00002000:00010000:1.0:1788746290.537143:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788746290.537145:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788746291 -> 1788746291 00002000:00010000:1.0:1788746290.537147:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788746290.537190:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163510528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (433us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788746290.537206:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788746290.537227:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788746290.537256:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd47d0f0000/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788746290.537262:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163510528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788746290.538205:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746290.538219:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163510656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788746290.538269:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746290.538307:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163510656 00000100:00100000:3.0:1788746290.538312:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163510656 00000100:00100000:3.0:1788746290.538350:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788746290.538358:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875636163510656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788746290.538378:0:6680:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788746290.538428:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e1a30, atime: 0x6a9e1a30, ctime: 0x6a9e1a30, blocks: 0x1 00010000:00010000:3.0:1788746290.538437:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.538453:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1788746290.538458:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746290.538464:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.538479:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.538488:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.538495:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.538512:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788746290.541478:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163510656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3114us (3202us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788746290.541500:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788746290.543343:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746290.543356:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.543370:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746290.543375:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.543385:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.543425:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.543432:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a880b851/0xe59b64da5b309eef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.543451:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746290.543453:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746290.543455:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746290.543579:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788746290.549022:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd48001df80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788746290.549036:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163510656:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788746290.601813:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788746290.601847:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788746290.602115:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141467136:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 Request processed in 67575us (67745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746290.602127:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:2.0:1788746290.605154:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.605196:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467392 00000100:00100000:3.0:1788746290.605205:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467392 00000100:00100000:3.0:1788746290.605380:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 81 00000100:00100000:3.0:1788746290.605631:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10434:x1875636141467392:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788746290.605679:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746290.605705:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2f0 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.605720:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746290.605725:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746290.605773:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.605787:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.605796:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746290.605996:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000907660a8 reply state 00000000f0f7079d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746290.606003:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746290.606141:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10434:x1875636141467392:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 513us (994us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788746290.606149:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 81 00010000:00010000:2.0:1788746290.607473:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607501:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607508:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607514:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.607518:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607525:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607537:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746290.607539:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.607543:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.607550:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ef6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.608362:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746290.608506:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467520 00000100:00100000:1.0:1788746290.608516:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467520 00000100:00100000:1.0:1788746290.608676:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:1.0:1788746290.608687:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141467520:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788746290.608931:0:8456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788746290.608935:0:8456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788746291 -> 1788746290 00002000:00010000:1.0:1788746290.608938:0:8456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788746288 00002000:00010000:1.0:1788746290.608940:0:8456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788746291 -> 1788746290 00002000:00010000:1.0:1788746290.608942:0:8456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788746290.609000:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141467520:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 311us (636us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788746290.609007:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:1.0:1788746290.611792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746290.611872:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467776 00000100:00100000:0.0:1788746290.611893:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467776 00000100:00100000:0.0:1788746290.611954:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:0.0:1788746290.611963:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10434:x1875636141467776:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788746290.612025:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.612041:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.612049:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.612082:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.612112:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 13 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746290.612127:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163510784:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746290.612211:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788746290.614201:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163510784:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746290.614225:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.617742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.618394:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141467904 00000100:00100000:2.0:1788746290.618452:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141467904 00010000:00010000:2.0:1788746290.618493:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.618541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:2.0:1788746290.618551:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2350:x1875636141467904:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746290.618581:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746290.618589:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618601:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618621:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e2 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618636:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746290.618641:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618651:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618659:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.618693:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746290.618743:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2350:x1875636141467904:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 193us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746290.618750:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:2.0:1788746290.619326:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746290.619340:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163510912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746290.619476:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746290.619515:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163510912 00000100:00100000:2.0:1788746290.619528:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163510912 00010000:00010000:1.0:1788746290.619575:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619585:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619611:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619618:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619624:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.619631:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746290.619638:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163510912:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746290.619640:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746290.619644:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619650:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619660:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:1.0:1788746290.619662:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00002000:00000024:2.0:1788746290.619664:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00010000:00010000:1.0:1788746290.619666:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.619671:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b309efd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.619714:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163510912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746290.619720:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746290.619785:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163510912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746290.620144:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+12:10434:x1875636141467776:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 Request processed in 8181us (8359us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788746290.620151:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:1.0:1788746290.622015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.622092:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468032 00000100:00100000:2.0:1788746290.622100:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468032 00000100:00100000:2.0:1788746290.622154:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:2.0:1788746290.622164:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141468032:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.622201:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.622219:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.622228:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788746290.622231:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746290.622235:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.622265:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.622280:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 7 pid: 8456 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.622308:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875636163511040:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746290.623146:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746290.626986:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746290.627131:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875636163511040:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746290.627156:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746290.627223:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468160 00000100:00100000:3.0:1788746290.627242:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468160 00010000:00010000:3.0:1788746290.627274:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 8 pid: 8456 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746290.627312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:3.0:1788746290.627322:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141468160:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746290.627336:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746290.627357:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 8 pid: 8456 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.627371:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 8 pid: 8456 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.627427:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aa84230/0xe59b64da5b309ee8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2fe expref: 8 pid: 8456 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.627444:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746290.627448:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746290.627453:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.627462:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.627485:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746290.627532:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141468160:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 211us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.627549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 44 00010000:00010000:1.0:1788746290.627612:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627620:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627648:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627655:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627662:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627668:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746290.627673:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627680:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627691:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.627698:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c45cee/0xe59b64da5b309f04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.627741:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141468032:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 Request processed in 5579us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746290.627749:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:1.0:1788746290.630806:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746290.630893:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468416 00000100:00100000:2.0:1788746290.630904:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468416 00000100:00100000:2.0:1788746290.630967:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 83 00000100:00100000:2.0:1788746290.630978:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+12:10434:x1875636141468416:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788746290.631047:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631063:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631075:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631290:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631302:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631311:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631342:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.631368:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 13 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.631385:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511168:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746290.631484:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746290.635042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.635115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468544 00000100:00100000:3.0:1788746290.635123:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468544 00010000:00010000:3.0:1788746290.635164:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746290.635203:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:3.0:1788746290.635213:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2350:x1875636141468544:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746290.635228:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746290.635235:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.635249:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 14 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.635271:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746290.635276:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.635285:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.635292:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.635310:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746290.635363:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2350:x1875636141468544:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 151us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.635385:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00010000:00010000:1.0:1788746290.635606:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2e9 expref: 13 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.635621:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511168:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746290.635640:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.635648:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.635653:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788746290.635841:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788746290.635986:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788746290.636034:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788746290.636913:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163511296:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788746290.636975:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746290.637010:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746290.637205:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163511296 00000100:00100000:3.0:1788746290.637212:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163511296 00000100:00100000:3.0:1788746290.637259:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746290.637268:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163511296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788746290.637347:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163511296:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.637353:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746290.637439:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788746290.637445:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd47d0f0000, transno 4294967303 00000100:00100000:0.0:1788746290.637467:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163511296:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788746290.637957:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788746290.638018:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163511424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788746290.638053:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746290.638070:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746290.638972:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163511424 00000100:00100000:3.0:1788746290.638979:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163511424 00000100:00100000:3.0:1788746290.639012:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746290.639021:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163511424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788746290.639191:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875636163511424:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (1136us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788746290.639199:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746290.639877:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163511424:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788746290.639913:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.639922:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.639930:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.639962:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746290.639967:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.639975:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.639989:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:0.0:1788746290.639992:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746290.639996:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640002:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b309f12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640038:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640044:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640049:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640054:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746290.640057:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640063:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640080:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:0.0:1788746290.640082:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746290.640085:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640091:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309e40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640113:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640126:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 16 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640135:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640164:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 16 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746290.640179:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 16 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746290.640191:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d379c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511552:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746290.640261:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746290.653649:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d379c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511552:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746290.653678:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.655579:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.656075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468672 00000100:00100000:3.0:1788746290.656085:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468672 00010000:00010000:3.0:1788746290.656122:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 17 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746290.656214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:3.0:1788746290.656224:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+17:2350:x1875636141468672:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746290.656238:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746290.656245:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 17 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656276:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 17 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656297:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b309e5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b2cd expref: 17 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656313:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:3.0:1788746290.656318:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656327:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656334:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.656368:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746290.656456:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:2350:x1875636141468672:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 232us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746290.656463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00010000:00010000:2.0:1788746290.656603:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656611:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656622:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656629:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656635:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656641:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.656644:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656651:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656671:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:2.0:1788746290.656674:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746290.656678:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656684:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b309f19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656695:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656701:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656707:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656711:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746290.656714:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656720:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656727:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e400) 00010000:00010000:2.0:1788746290.656730:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746290.656732:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746290.656745:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b309f0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746290.656933:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10434:x1875636141468416:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 25957us (26135us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788746290.656942:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 83 00000020:00080000:2.0:1788746290.656957:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788746290.657055:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746290.657059:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746290.657082:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788746290.657087:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788746290.671342:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.671467:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141468928 00000100:00100000:3.0:1788746290.671478:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141468928 00000100:00100000:3.0:1788746290.671533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:3.0:1788746290.671542:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10434:x1875636141468928:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788746290.672477:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788746290.672571:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788746290.672616:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672638:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672650:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672658:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672665:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672671:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.672683:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788746290.672781:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+17:10434:x1875636141468928:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 1237us (1444us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788746290.672789:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00000020:00080000:3.0:1788746290.672794:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746290.674718:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746290.674729:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.674739:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746290.674743:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.674773:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.674790:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cd44773eb00) 00010000:00010000:1.0:1788746290.674793:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788746290.674798:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.674805:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.674824:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746290.674826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746290.674828:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746290.683571:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746290.841133:0:11988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746290.841143:0:11988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746290.841187:0:11988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788746290.841193:0:11988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788746290.972383:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746290.972467:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141469184 00000100:00100000:3.0:1788746290.972477:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141469184 00000100:00100000:3.0:1788746290.972534:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:3.0:1788746290.972544:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+17:10444:x1875636141469184:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746290.972564:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746290.972588:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b305 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.972676:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309f2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.972689:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.972699:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746290.972710:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788746290.972842:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b305 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.972857:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309f2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b305 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746290.972866:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746290.972869:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788746290.972872:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940600, rc 0) 00000100:00100000:3.0:1788746290.972941:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10444:x1875636141469184:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 399us (566us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788746290.972947:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:2.0:1788746290.982598:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746290.982783:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141469312 00000100:00100000:1.0:1788746290.982794:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141469312 00000100:00100000:1.0:1788746290.982856:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00100000:1.0:1788746290.982866:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10444:x1875636141469312:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:1.0:1788746290.982935:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.982950:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.982960:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.982975:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.982996:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983002:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983206:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983214:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983221:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746290.983258:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983270:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983276:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983283:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983289:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746290.983293:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983300:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983318:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746290.983321:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746290.983326:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983332:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983346:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983351:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983358:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983364:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746290.983367:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983373:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983379:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd4511ad500) 00010000:00010000:1.0:1788746290.983383:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746290.983387:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983392:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983448:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983455:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983460:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983465:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746290.983468:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983474:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983487:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad000) 00010000:00010000:1.0:1788746290.983489:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746290.983492:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746290.983498:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746290.983579:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10444:x1875636141469312:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 713us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746290.983586:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00100000:2.0:1788746291.079690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.079769:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141469568 00000100:00100000:3.0:1788746291.079777:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141469568 00000100:00100000:3.0:1788746291.079852:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00100000:3.0:1788746291.079863:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10447:x1875636141469568:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746291.079889:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.079908:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b30c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.079971:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.079986:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.079997:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080011:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080018:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080024:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080261:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080270:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080278:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746291.080287:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788746291.080374:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080382:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080388:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080394:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.080419:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080427:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080437:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746291.080441:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.080445:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080451:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b309f58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080464:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080469:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080474:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080479:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.080488:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080494:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080502:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773ec00) 00010000:00010000:3.0:1788746291.080505:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.080508:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080513:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080549:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080562:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.080569:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.080571:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746291.080574:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:3.0:1788746291.080619:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10447:x1875636141469568:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 760us (939us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788746291.080626:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00080000:1.0:1788746291.080944:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746291.093236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.093380:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141469696 00000100:00100000:1.0:1788746291.093390:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141469696 00000100:00100000:1.0:1788746291.093500:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:1.0:1788746291.093509:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10447:x1875636141469696:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746291.093569:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093585:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093595:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093618:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093624:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093631:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093638:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.093642:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093648:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093659:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.093662:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746291.093666:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.093682:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.095787:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10447:x1875636141469696:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 2271us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746291.095800:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:3.0:1788746291.103535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.103941:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141469952 00000100:00100000:1.0:1788746291.103951:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141469952 00000100:00100000:1.0:1788746291.105043:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:1.0:1788746291.105057:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10447:x1875636141469952:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:1.0:1788746291.105270:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+22:10447:x1875636141469952:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 216us (1743us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788746291.105278:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:3.0:1788746291.171601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.179847:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470208 00000100:00100000:0.0:1788746291.179860:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470208 00000100:00100000:1.0:1788746291.181728:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 88 00000100:00100000:1.0:1788746291.181741:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+22:9975:x1875636141470208:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:1.0:1788746291.181775:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746291.181796:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b313 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.181889:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.181903:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.181912:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.181957:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.181983:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 23 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.181996:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163511680:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746291.182077:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870600 going to sleep for 11 seconds 00000100:00100000:2.0:1788746291.192905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.193053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470336 00000100:00100000:3.0:1788746291.193074:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470336 00010000:00010000:3.0:1788746291.193111:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 24 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.193152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:3.0:1788746291.193161:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141470336:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746291.193174:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746291.193180:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 24 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.193192:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 24 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.193211:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.193217:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.193238:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.193246:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.193265:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746291.193318:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141470336:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 157us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.193325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00010000:00010000:1.0:1788746291.194514:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b30c expref: 23 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.194531:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163511680:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746291.194551:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.194560:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.194566:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746291.194585:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788746291.194717:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309f7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.194736:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.194771:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.194774:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788746291.194777:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400400, rc 0) 00000100:00100000:1.0:1788746291.194827:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+23:9975:x1875636141470208:12345-192.168.206.24@tcp:101:bash.0 Request processed in 13088us (23233us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788746291.194836:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 88 00000100:00100000:2.0:1788746291.196721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.196962:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470592 00000100:00100000:3.0:1788746291.196970:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470592 00000100:00100000:3.0:1788746291.197029:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 89 00000100:00100000:3.0:1788746291.197039:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+23:9975:x1875636141470592:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:3.0:1788746291.197261:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.197277:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.197289:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746291.197340:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788746291.197363:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001d28e9a0 reply state 00000000b6793286 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.197372:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788746291.197442:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788746291.197580:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+27:9975:x1875636141470592:12345-192.168.206.24@tcp:36:bash.0 Request processed in 541us (862us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788746291.197587:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 89 00000020:00080000:3.0:1788746291.197592:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788746291.214376:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214393:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214430:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214437:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.214442:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214450:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214465:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.214468:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.214473:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.214478:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309f90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.216707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.217324:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470720 00000100:00100000:3.0:1788746291.217333:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470720 00000100:00100000:3.0:1788746291.217390:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:3.0:1788746291.217435:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:9975:x1875636141470720:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746291.217466:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.217486:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b31a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.217541:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b31a expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.217570:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b31a expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.217590:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.217594:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746291.217597:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746291.217649:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+27:9975:x1875636141470720:12345-192.168.206.24@tcp:101:bash.0 Request processed in 250us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.217657:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:0.0:1788746291.223339:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.223424:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470848 00000100:00100000:3.0:1788746291.223434:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470848 00000100:00100000:3.0:1788746291.223495:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:3.0:1788746291.223505:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd443773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:9975:x1875636141470848:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746291.223523:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.223544:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b321 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746291.223569:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e1a32, atime: 0x6a9e1a30, ctime: 0x6a9e1a32, blocks: 0xb 00010000:00010000:3.0:1788746291.223590:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788746291.223594:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746291.223602:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.223616:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.223645:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940400, rc 0) 00000100:00100000:3.0:1788746291.223704:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd443773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:9975:x1875636141470848:12345-192.168.206.24@tcp:101:bash.0 Request processed in 200us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.223711:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:2.0:1788746291.226527:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.227791:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141470976 00000100:00100000:3.0:1788746291.227804:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141470976 00002000:00010000:3.0:1788746291.227847:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788746291.227852:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5d880 with x1875636141470976 ext(0->18446744073709551615) 00002000:00010000:3.0:1788746291.227864:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd477b5d880. 00000100:00100000:3.0:1788746291.227912:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:3.0:1788746291.227922:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141470976:12345-192.168.206.24@tcp:10:bash.0 00002000:00010000:3.0:1788746291.228178:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788746291.228183:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788746290 -> 1788746291 00002000:00010000:3.0:1788746291.228185:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788746288 -> 1788746288 00002000:00010000:3.0:1788746291.228188:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788746290 -> 1788746291 00002000:00010000:3.0:1788746291.228190:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788746291.228255:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141470976:12345-192.168.206.24@tcp:10:bash.0 Request processed in 334us (1735us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788746291.228263:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00002000:00010000:3.0:1788746291.228267:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788746291.228270:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5d880 with x1875636141470976 ext(0->18446744073709551615) 00002000:00010000:3.0:1788746291.228275:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd477b5d880. 00000100:00100000:2.0:1788746291.297500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.297598:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141471104 00000100:00100000:1.0:1788746291.297608:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141471104 00000100:00100000:1.0:1788746291.297663:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 91 00000100:00100000:1.0:1788746291.297672:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+27:10461:x1875636141471104:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:1.0:1788746291.297754:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.297794:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.297806:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.297821:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.297828:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.297834:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298053:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298064:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298071:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746291.298119:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298131:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298138:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298145:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298152:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.298155:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298163:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298175:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746291.298178:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.298182:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298188:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b309fa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298204:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298210:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298221:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298226:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.298229:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298236:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298242:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd4511ad000) 00010000:00010000:1.0:1788746291.298244:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.298247:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298253:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b309fac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298266:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298272:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298277:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298281:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.298284:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298298:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298306:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.298309:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.298312:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.298318:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b309fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.298394:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+27:10461:x1875636141471104:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 721us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746291.299266:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 91 00000100:00100000:0.0:1788746291.332988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.333139:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141471360 00000100:00100000:3.0:1788746291.333148:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141471360 00000100:00100000:3.0:1788746291.333212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 92 00000100:00100000:3.0:1788746291.333222:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+27:10464:x1875636141471360:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746291.333252:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.333273:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b328 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333337:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333350:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333361:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333375:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333381:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333388:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333660:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333670:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333678:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746291.333698:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788746291.333796:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333804:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333811:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333817:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.333821:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333828:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333839:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746291.333842:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.333846:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333851:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333862:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333868:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333883:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333887:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.333891:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333896:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333904:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773ee00) 00010000:00010000:3.0:1788746291.333906:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.333909:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.333915:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.334028:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b328 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.334043:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b328 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.334050:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.334052:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788746291.334054:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746291.334214:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10464:x1875636141471360:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 992us (1232us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788746291.334231:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 92 00000100:00100000:2.0:1788746291.338268:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.338378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141471488 00000100:00100000:3.0:1788746291.338386:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141471488 00000100:00100000:3.0:1788746291.338473:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:3.0:1788746291.338481:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+29:10464:x1875636141471488:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:3.0:1788746291.338540:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.338553:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.338561:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.338589:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.338601:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 29 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.338612:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511808:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746291.338680:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746291.342589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.342769:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163511808:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746291.342793:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746291.342873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141471744 00000100:00100000:0.0:1788746291.342890:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141471744 00000100:00100000:0.0:1788746291.342943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:0.0:1788746291.343109:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+30:5587:x1875636141471744:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1788746291.343450:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1788746291.343556:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+32:5587:x1875636141471744:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 451us (973us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788746291.343564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00000020:00080000:0.0:1788746291.343569:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788746291.345674:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.345782:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141471872 00000100:00100000:1.0:1788746291.345790:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141471872 00010000:00010000:1.0:1788746291.345826:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 32 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.345865:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:1.0:1788746291.345885:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+32:2350:x1875636141471872:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746291.345898:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746291.345905:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 32 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.345917:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 32 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.346118:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b309f82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b313 expref: 32 pid: 5851 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.346139:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.346145:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.346154:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.346162:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.346195:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746291.346260:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+31:2350:x1875636141471872:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 385us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746291.346267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 48 00010000:00010000:3.0:1788746291.346327:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346340:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346365:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346373:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346380:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346386:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.346390:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346446:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346456:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.346458:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746291.346462:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.346468:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.346507:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+30:10464:x1875636141471488:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 8027us (8246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.346515:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:2.0:1788746291.349681:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.349752:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141472128 00000100:00100000:1.0:1788746291.349769:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141472128 00000100:00100000:1.0:1788746291.349824:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:1.0:1788746291.349834:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+30:10464:x1875636141472128:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:1.0:1788746291.350055:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+31:10464:x1875636141472128:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 221us (377us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788746291.350061:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:2.0:1788746291.445045:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.445183:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141472384 00000100:00100000:3.0:1788746291.445192:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141472384 00000100:00100000:3.0:1788746291.445258:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:3.0:1788746291.445268:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+31:10475:x1875636141472384:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:3.0:1788746291.445290:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.445309:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b32f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445374:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445387:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445435:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445451:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445460:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445466:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445697:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445706:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445725:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746291.445750:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788746291.445841:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445849:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445857:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445863:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.445867:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445886:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445897:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746291.445901:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.445905:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445911:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b309feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445923:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445929:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445941:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445956:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.445960:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445966:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445974:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773ee00) 00010000:00010000:3.0:1788746291.445977:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.445979:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.445985:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b309ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.446023:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b309fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b32f expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.446037:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b32f expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.446044:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746291.446046:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746291.446049:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941e00, rc 0) 00000100:00100000:3.0:1788746291.446099:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+33:10475:x1875636141472384:12345-192.168.206.24@tcp:101:cat.0 Request processed in 832us (1061us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788746291.446115:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:3.0:1788746291.452624:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.452712:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141472640 00000100:00100000:1.0:1788746291.452721:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141472640 00000100:00100000:1.0:1788746291.452792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:1.0:1788746291.452815:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+33:10475:x1875636141472640:12345-192.168.206.24@tcp:35:cat.0 00000100:00100000:1.0:1788746291.453280:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:10475:x1875636141472640:12345-192.168.206.24@tcp:35:cat.0 Request processed in 466us (663us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788746291.453288:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:2.0:1788746291.469771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.469909:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141472896 00000100:00100000:1.0:1788746291.469919:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141472896 00000100:00100000:1.0:1788746291.469983:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 95 00000100:00100000:1.0:1788746291.469993:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+34:10476:x1875636141472896:12345-192.168.206.24@tcp:36:rm.0 00010000:00010000:1.0:1788746291.470041:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788746291.470065:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b309ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b32f expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470085:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b309fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b328 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470096:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b309f97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b31a expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470105:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746291.470114:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746291.470132:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470144:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470152:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470182:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470190:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470197:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470601:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470610:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.470618:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746291.471571:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788746291.471582:0:8618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365876182891ns, next at 366876180535ns, rc = 0 00010000:00010000:1.0:1788746291.471644:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471657:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471666:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471674:0:8618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471689:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471694:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471720:0:8618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746291.471748:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471754:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471769:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471775:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.471779:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471785:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471794:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:1.0:1788746291.471797:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788746291.471801:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471807:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a015 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471827:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471841:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471847:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471852:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.471855:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471861:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471869:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746291.471872:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.471875:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.471880:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746291.471893:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000053d5efe0 reply state 00000000eac7d9bf transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.471902:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788746291.472236:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746291.472243:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.472249:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746291.472252:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.472258:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.472266:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cd4511ad500) 00010000:00010000:3.0:1788746291.472269:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788746291.472272:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.472277:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a01c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.472292:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746291.472294:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746291.472296:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746291.472515:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+33:10476:x1875636141472896:12345-192.168.206.24@tcp:36:rm.0 Request processed in 2520us (2758us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788746291.472523:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 95 00010000:00010000:0.0:1788746291.480595:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480611:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480619:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480626:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746291.480631:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480639:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480654:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd4511ad000) 00010000:00010000:0.0:1788746291.480658:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746291.480664:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.480688:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a00e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.515458:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.515570:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473152 00000100:00100000:3.0:1788746291.515579:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473152 00000100:00100000:3.0:1788746291.515643:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 96 00000100:00100000:3.0:1788746291.515654:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+32:10482:x1875636141473152:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746291.515677:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.515710:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a023 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b336 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515826:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515841:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515852:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515865:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515884:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.515891:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746291.516443:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788746291.516590:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516601:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516609:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516638:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516655:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516661:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516666:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.516670:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516677:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516690:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746291.516692:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746291.516696:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516702:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a02a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746291.516713:0:5849:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a9c81dc6 reply state 0000000083f5cf97 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.516721:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788746291.516747:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a023 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516775:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.516793:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:3.0:1788746291.516795:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746291.516798:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746291.516866:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10482:x1875636141473152:12345-192.168.206.24@tcp:101:bash.0 Request processed in 1214us (1416us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788746291.516875:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 96 00010000:00010000:1.0:1788746291.519943:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.519977:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.519984:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.519989:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.519994:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.520001:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.520015:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773ee00) 00010000:00010000:1.0:1788746291.520019:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.520023:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.520029:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.523101:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.523188:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473280 00000100:00100000:0.0:1788746291.523197:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473280 00000100:00100000:0.0:1788746291.523267:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:0.0:1788746291.523277:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141473280:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746291.523294:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746291.523312:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b33d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746291.523335:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746291.523352:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788746291.523357:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746291.523366:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.523383:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.523395:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8000, rc 0) 00000100:00100000:0.0:1788746291.523474:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141473280:12345-192.168.206.24@tcp:101:bash.0 Request processed in 199us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746291.523481:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00080000:1.0:1788746291.523749:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746291.527959:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.528102:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473408 00000100:00100000:0.0:1788746291.528114:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473408 00000100:00100000:0.0:1788746291.528180:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:0.0:1788746291.528190:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:10482:x1875636141473408:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746291.528207:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746291.528224:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b344 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.528267:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.528276:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746291.528280:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746291.528284:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.528314:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.528327:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 9 pid: 6682 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746291.528339:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d379500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875636163511936:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746291.528465:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746291.530970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746291.531100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473536 00000100:00100000:2.0:1788746291.531108:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473536 00010000:00010000:2.0:1788746291.531141:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 10 pid: 6682 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.531198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:2.0:1788746291.531207:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141473536:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746291.531220:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746291.531246:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 10 pid: 6682 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.531260:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 10 pid: 6682 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.531281:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746291.531286:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746291.531292:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.531302:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.531337:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.531350:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875636163512064:192.168.206.24@tcp:105: 00000100:00100000:2.0:1788746291.531454:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44744e3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788746291.531913:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a046 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b33d expref: 10 pid: 6682 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746291.531927:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d379500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875636163511936:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746291.531957:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.531967:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9600, rc 0) 00000100:00100000:0.0:1788746291.532010:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:10482:x1875636141473408:12345-192.168.206.24@tcp:101:bash.0 Request processed in 3821us (4062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746291.532018:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:2.0:1788746291.535539:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875636163512064:192.168.206.24@tcp:105: 00010000:00010000:2.0:1788746291.535583:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746291.535638:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141473536:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 4431us (4674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746291.535648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:2.0:1788746291.538956:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.539091:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473792 00000100:00100000:1.0:1788746291.539099:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473792 00000100:00100000:1.0:1788746291.539147:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:1.0:1788746291.539156:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:10482:x1875636141473792:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:1.0:1788746291.539502:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10482:x1875636141473792:12345-192.168.206.24@tcp:35:bash.0 Request processed in 346us (553us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788746291.539510:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:1.0:1788746291.686778:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.686912:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141473920 00000100:00100000:3.0:1788746291.686922:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141473920 00000100:00100000:3.0:1788746291.686975:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:3.0:1788746291.686985:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+35:10498:x1875636141473920:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746291.687007:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.687027:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b34b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687095:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687108:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687121:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746291.687150:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788746291.687154:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746291.687184:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687206:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b34b expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687223:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b34b expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.687231:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746291.687234:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746291.687237:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746291.687305:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+36:10498:x1875636141473920:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 321us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.687313:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:3.0:1788746291.693677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746291.693794:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474176 00000100:00100000:2.0:1788746291.693803:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474176 00000100:00100000:2.0:1788746291.693859:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:2.0:1788746291.693868:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+36:10498:x1875636141474176:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746291.693896:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746291.693916:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b352 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.693998:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.694011:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.694021:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746291.694032:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788746291.694156:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b352 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.694172:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b352 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.694196:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:2.0:1788746291.694199:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746291.694202:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746291.694262:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+38:10498:x1875636141474176:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 394us (590us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788746291.694280:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:2.0:1788746291.701790:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.701924:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474432 00000100:00100000:3.0:1788746291.701935:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474432 00000100:00100000:3.0:1788746291.701989:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:3.0:1788746291.701998:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+38:10498:x1875636141474432:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746291.702019:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746291.702038:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b359 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.702129:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.702142:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.702167:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746291.702180:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788746291.702304:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b359 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.702322:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b359 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.702330:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:3.0:1788746291.702333:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788746291.702336:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746291.702442:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+40:10498:x1875636141474432:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 399us (614us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788746291.702450:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:3.0:1788746291.704983:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:0.0:1788746291.706717:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746291.712967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.713048:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474688 00000100:00100000:0.0:1788746291.713067:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474688 00000100:00100000:0.0:1788746291.713122:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:0.0:1788746291.713131:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2348:x1875636141474688:12345-192.168.206.24@tcp:1:lfs.0 00010000:00010000:0.0:1788746291.713176:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.713197:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.713206:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00000100:00100000:1.0:1788746291.713210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474560 00010000:00010000:0.0:1788746291.713212:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1788746291.713218:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474560 00010000:00010000:0.0:1788746291.713220:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.713260:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.713269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:1.0:1788746291.713280:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+40:2349:x1875636141474560:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746291.713287:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 8 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.713292:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788746291.713317:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d379500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875636163512192:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746291.713326:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b352 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.713344:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:1.0:1788746291.713349:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746291.713380:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+39:2349:x1875636141474560:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 103us (9155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746291.713388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:0.0:1788746291.713426:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746291.720455:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d379500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875636163512192:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746291.720481:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.721591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.722200:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474816 00000100:00100000:1.0:1788746291.722208:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474816 00002000:00100000:1.0:1788746291.722246:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cd477b5e680 x1875636141474816/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:302/0 lens 504/0 e 0 to 0 dl 1788746302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788746291.722257:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5e680 with x1875636141474816 ext(0->8) 00010000:00010000:1.0:1788746291.722266:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 9 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.722293:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 9 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746291.722301:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd477b5e680 00000100:00100000:1.0:1788746291.722332:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:1.0:1788746291.722351:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141474816:12345-192.168.206.24@tcp:4:lfs.0 00000100:00100000:0.0:1788746291.723279:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+11:2350:x1875636141474816:12345-192.168.206.24@tcp:4:lfs.0 Request processed in 915us (1679us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788746291.723293:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00002000:00100000:0.0:1788746291.723302:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cd477b5e680 x1875636141474816/t4294967302(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:302/0 lens 504/448 e 0 to 0 dl 1788746302 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788746291.723310:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5e680 with x1875636141474816 ext(0->8) 00010000:00010000:0.0:1788746291.723318:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746291.723331:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746291.723338:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd477b5e680 00000100:00100000:3.0:1788746291.726589:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.726768:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141474944 00000100:00100000:0.0:1788746291.726777:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141474944 00010000:00010000:0.0:1788746291.726814:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.726968:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:2.0:1788746291.726982:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+11:2349:x1875636141474944:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746291.726996:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788746291.727012:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788746291.727015:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788746292 00002000:00010000:2.0:1788746291.727017:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788746292 00002000:00010000:2.0:1788746291.727019:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788746292 00010000:00010000:2.0:1788746291.727026:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.727039:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.727075:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a04d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b344 expref: 11 pid: 6680 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.727105:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746291.727109:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746291.727115:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.727125:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.727165:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746291.727220:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141474944:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 240us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746291.727238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 50 00010000:00010000:1.0:1788746291.727438:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727450:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727472:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727481:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727489:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727496:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746291.727500:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727508:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727521:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.727542:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30a08c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.727588:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2348:x1875636141474688:12345-192.168.206.24@tcp:1:lfs.0 Request processed in 14457us (14628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746291.727596:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:1.0:1788746291.730348:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746291.730438:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141475200 00000100:00100000:2.0:1788746291.730447:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141475200 00000100:00100000:2.0:1788746291.730498:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:2.0:1788746291.730508:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+39:10498:x1875636141475200:12345-192.168.206.24@tcp:35:lfs.0 00000004:00010000:2.0:1788746291.730567:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b359 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746291.730823:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788746291.730868:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788746291.731202:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1788746291.731254:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.731268:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.731285:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.731315:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.731329:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 43 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.731342:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1875636163512320:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746291.731441:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44744e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746291.734340:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1875636163512320:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746291.734366:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746291.736282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.736942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141475328 00000100:00100000:3.0:1788746291.736955:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141475328 00010000:00010000:3.0:1788746291.737004:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 44 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.737046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:3.0:1788746291.737068:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+44:2350:x1875636141475328:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746291.737083:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746291.737105:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 44 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737118:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 44 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737143:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b336 expref: 44 pid: 5849 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737158:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:3.0:1788746291.737164:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737174:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737181:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.737213:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746291.737491:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.737500:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746291.737612:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1788746291.737839:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788746291.737942:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163512448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788746291.737989:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746291.738117:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44744e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788746291.738497:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+45:2350:x1875636141475328:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 1439us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.738506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:0.0:1788746291.742800:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163512448 00000100:00100000:0.0:1788746291.742814:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163512448 00000100:00100000:0.0:1788746291.742933:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746291.742943:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1875636163512448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788746291.743079:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1875636163512448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (5089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746291.743086:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788746291.743160:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163512448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788746291.743680:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788746291.743773:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163512576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788746291.743822:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746291.744612:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44744e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746291.744686:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163512576 00000100:00100000:1.0:1788746291.744693:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163512576 00000100:00100000:1.0:1788746291.744739:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746291.744748:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875636163512576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788746291.745110:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5853:x1875636163512576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 362us (1287us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788746291.745118:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788746291.745662:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163512576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788746291.745807:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788746291.745849:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745860:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745866:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745935:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746291.745939:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745946:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745960:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:2.0:1788746291.745962:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788746291.745966:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.745972:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a093 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788746291.746217:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788746291.746575:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788746291.746586:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366151186652ns, next at 367151184312ns, rc = 0 00000001:00080000:2.0:1788746291.746592:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788746291.746627:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd44773e600) 00010000:00010000:2.0:1788746291.746631:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788746291.746638:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a07e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b359 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.746846:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+46:10498:x1875636141475200:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 16338us (16504us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788746291.746855:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 26 00000020:00080000:2.0:1788746291.746859:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788746291.761516:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746291.762137:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141475456 00000100:00100000:2.0:1788746291.762146:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141475456 00000100:00100000:2.0:1788746291.763719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00100000:2.0:1788746291.763746:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+46:10498:x1875636141475456:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746291.763779:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746291.763800:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a09a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b360 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.763855:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a09a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b360 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.763868:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a09a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b360 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.763895:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746291.763899:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746291.763913:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746291.763979:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10498:x1875636141475456:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 249us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746291.763987:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00100000:3.0:1788746291.766658:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.766741:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141475712 00000100:00100000:0.0:1788746291.766750:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141475712 00000100:00100000:0.0:1788746291.766813:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:0.0:1788746291.766823:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+47:10498:x1875636141475712:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746291.767038:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10498:x1875636141475712:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 215us (385us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788746291.767045:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:3.0:1788746291.870467:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746291.870567:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141475840 00000100:00100000:2.0:1788746291.870576:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141475840 00000100:00100000:2.0:1788746291.870631:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:2.0:1788746291.870640:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10508:x1875636141475840:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:2.0:1788746291.870704:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870720:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870741:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870767:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870775:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870782:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870855:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870864:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870899:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746291.870936:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870947:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870954:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870961:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870967:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746291.870971:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870978:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.870989:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746291.870992:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746291.870996:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871003:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a0a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871016:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871027:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871033:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871039:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746291.871041:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871047:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871055:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1acf00) 00010000:00010000:2.0:1788746291.871058:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746291.871060:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871066:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a0a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871079:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871086:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871092:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871097:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746291.871104:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871111:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871119:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746291.871121:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746291.871124:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746291.871130:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a0af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746291.871199:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10508:x1875636141475840:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 559us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746291.871207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:0.0:1788746291.926372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746291.926483:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141476096 00000100:00100000:1.0:1788746291.926492:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141476096 00000100:00100000:1.0:1788746291.926547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:1.0:1788746291.926557:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+48:10511:x1875636141476096:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746291.926574:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746291.926593:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b367 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926654:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926683:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926694:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926708:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926715:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926722:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926843:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a0cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926853:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926861:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746291.926883:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788746291.926974:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926982:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.926989:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927001:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.927006:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927012:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927023:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746291.927026:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.927030:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927034:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927051:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927057:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927063:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927068:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746291.927071:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927076:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927094:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd4511ad600) 00010000:00010000:1.0:1788746291.927097:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746291.927100:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927105:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927146:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b367 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927163:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b367 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746291.927170:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746291.927172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746291.927174:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401c00, rc 0) 00000100:00100000:1.0:1788746291.927240:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10511:x1875636141476096:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 685us (876us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788746291.927248:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:2.0:1788746291.934877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746291.934952:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141476224 00000100:00100000:3.0:1788746291.934962:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141476224 00000100:00100000:3.0:1788746291.935012:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 103 00000100:00100000:3.0:1788746291.935023:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10511:x1875636141476224:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:3.0:1788746291.935092:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935108:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935120:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935142:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935150:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935158:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935164:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746291.935167:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935174:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935185:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746291.935188:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746291.935193:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746291.935200:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746291.935329:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10511:x1875636141476224:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 308us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746291.935336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 103 00000100:00100000:3.0:1788746291.944482:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746291.944559:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141476480 00000100:00100000:0.0:1788746291.944568:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141476480 00000100:00100000:0.0:1788746291.944617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:0.0:1788746291.944626:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:10511:x1875636141476480:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746291.944845:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10511:x1875636141476480:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 219us (369us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788746291.944853:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:0.0:1788746292.060324:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.060424:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141476736 00000100:00100000:1.0:1788746292.060439:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141476736 00000100:00100000:1.0:1788746292.060495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 104 00000100:00100000:1.0:1788746292.060504:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+51:10521:x1875636141476736:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:1.0:1788746292.060524:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.060527:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788746292.060551:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a05b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b34b expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060581:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746292.060585:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746292.060597:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b36e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060678:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060691:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060701:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746292.060711:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788746292.060848:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b36e expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060864:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b36e expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.060872:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746292.060874:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746292.060877:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400a00, rc 0) 00000100:00100000:1.0:1788746292.060933:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10521:x1875636141476736:12345-192.168.206.24@tcp:101:bash.0 Request processed in 429us (617us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788746292.060940:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 104 00000100:00100000:2.0:1788746292.072201:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.072281:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141476992 00000100:00100000:3.0:1788746292.072290:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141476992 00000100:00100000:3.0:1788746292.072348:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 105 00000100:00100000:3.0:1788746292.072358:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10521:x1875636141476992:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:3.0:1788746292.072469:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788746292.072493:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a0e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b36e expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.072515:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a0cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b367 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.072526:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746292.072531:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746292.072707:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.072720:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.072977:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746292.073031:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788746292.073056:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002a2ded39 reply state 000000009d981a07 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746292.073071:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746292.073217:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10521:x1875636141476992:12345-192.168.206.24@tcp:36:bash.0 Request processed in 858us (1022us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788746292.073224:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 105 00000020:00080000:3.0:1788746292.073230:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788746292.091656:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:0.0:1788746292.091956:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.091982:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.091990:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.091996:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746292.092000:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.092007:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.092022:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:0.0:1788746292.092025:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746292.092029:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.092034:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a0f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746292.092665:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141477120 00000100:00100000:1.0:1788746292.092675:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141477120 00000100:00100000:1.0:1788746292.092738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 106 00000100:00100000:1.0:1788746292.092747:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:10521:x1875636141477120:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:1.0:1788746292.092775:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.092793:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b375 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092861:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092873:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092883:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746292.092908:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788746292.092912:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746292.092929:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092952:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a0fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092969:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.092976:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746292.092979:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746292.092990:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400800, rc 0) 00000100:00100000:1.0:1788746292.093046:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10521:x1875636141477120:12345-192.168.206.24@tcp:101:bash.0 Request processed in 300us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.093054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 106 00000100:00100000:0.0:1788746292.101906:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.101990:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141477376 00000100:00100000:3.0:1788746292.101999:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141477376 00000100:00100000:3.0:1788746292.102054:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:3.0:1788746292.102064:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+53:10521:x1875636141477376:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:3.0:1788746292.102278:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10521:x1875636141477376:12345-192.168.206.24@tcp:35:bash.0 Request processed in 214us (379us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788746292.102285:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:3.0:1788746292.222690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.222857:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141477504 00000100:00100000:1.0:1788746292.222865:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141477504 00000100:00100000:1.0:1788746292.222920:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 107 00000100:00100000:1.0:1788746292.222930:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+54:10527:x1875636141477504:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746292.222951:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.222972:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b37c expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223031:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223044:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223055:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746292.223088:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788746292.223092:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746292.223107:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223130:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b37c expref: 56 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223148:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b37c expref: 55 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.223168:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746292.223171:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746292.223175:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401e00, rc 0) 00000100:00100000:1.0:1788746292.223230:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141477504:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 302us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.223237:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 107 00000100:00100000:1.0:1788746292.231774:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.231902:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141477632 00000100:00100000:3.0:1788746292.231911:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141477632 00000100:00100000:3.0:1788746292.231980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 108 00000100:00100000:3.0:1788746292.231991:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141477632:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746292.232010:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746292.232045:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b383 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232104:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232118:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232141:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232157:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232164:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232170:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232250:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232260:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232267:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746292.232299:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788746292.232303:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746292.232319:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232330:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232338:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232354:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232359:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232365:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746292.232370:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232376:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232387:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746292.232390:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746292.232394:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232449:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a11f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232462:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232468:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232474:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232479:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746292.232489:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232495:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232503:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd44773e800) 00010000:00010000:3.0:1788746292.232506:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746292.232509:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232514:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a126 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232543:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b383 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232556:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b383 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.232563:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746292.232565:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746292.232567:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746292.232629:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10527:x1875636141477632:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 641us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.232637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 108 00000100:00100000:0.0:1788746292.240762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746292.240813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.240918:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478016 00000100:00100000:2.0:1788746292.240928:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478016 00000100:00100000:1.0:1788746292.240996:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141477888 00000100:00100000:1.0:1788746292.241001:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141477888 00000100:00100000:2.0:1788746292.241014:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:2.0:1788746292.241024:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:2348:x1875636141478016:12345-192.168.206.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788746292.241038:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 109 00010000:00010000:2.0:1788746292.241041:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788746292.241044:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10527:x1875636141477888:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746292.241060:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746292.241065:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a12d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b383 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.241075:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b38a expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.241081:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746292.241086:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746292.241146:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:2348:x1875636141478016:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 123us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.241152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00010000:00010000:1.0:1788746292.241164:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.241177:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.241184:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.241213:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.241235:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 56 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746292.241247:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163512704:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746292.242015:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746292.246587:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163512704:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746292.246614:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746292.246963:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.247366:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478144 00000100:00100000:1.0:1788746292.247384:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478144 00010000:00010000:1.0:1788746292.247439:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 57 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746292.247474:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:1.0:1788746292.247483:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+57:2350:x1875636141478144:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746292.247496:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746292.247501:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 57 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247513:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 57 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247545:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b375 expref: 57 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247581:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746292.247586:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247594:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247602:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.247629:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746292.247682:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:2350:x1875636141478144:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 200us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.247689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 52 00010000:00010000:2.0:1788746292.248701:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.248713:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746292.248733:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788746292.248887:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 57 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.248906:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 56 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.248914:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746292.248922:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746292.248925:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401c00, rc 0) 00000100:00100000:2.0:1788746292.248978:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10527:x1875636141477888:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 7933us (8233us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788746292.248986:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 109 00000100:00100000:2.0:1788746292.254284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.254369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478400 00000100:00100000:3.0:1788746292.254379:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478400 00000100:00100000:3.0:1788746292.254464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:3.0:1788746292.254474:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10527:x1875636141478400:12345-192.168.206.24@tcp:103:lfs.0 00010000:00010000:3.0:1788746292.254510:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746292.254533:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a09a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b360 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.254550:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746292.254555:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746292.254607:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141478400:12345-192.168.206.24@tcp:103:lfs.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.254614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:0.0:1788746292.258851:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.258923:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478528 00000100:00100000:3.0:1788746292.258932:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478528 00000100:00100000:3.0:1788746292.258990:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 110 00000100:00100000:3.0:1788746292.259000:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141478528:12345-192.168.206.24@tcp:58:lfs.0 00010000:00010000:3.0:1788746292.259090:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.259105:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.259117:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746292.259291:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788746292.259533:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141478528:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 534us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.259552:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 110 00000100:00100000:1.0:1788746292.269307:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.269393:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478656 00000100:00100000:3.0:1788746292.269437:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478656 00000100:00100000:3.0:1788746292.269508:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 111 00000100:00100000:3.0:1788746292.269518:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+55:10527:x1875636141478656:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746292.269537:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746292.269556:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b391 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269602:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269612:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269629:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269641:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269653:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746292.269656:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746292.269659:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.269666:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940000, rc 0) 00000100:00100000:3.0:1788746292.269710:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10527:x1875636141478656:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 195us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.269716:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 111 00000100:00100000:2.0:1788746292.667115:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667185:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667242:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163513344:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667269:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667310:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746292.667316:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667341:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667356:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163513472:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667378:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667423:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163513088:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667445:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667461:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746292.667466:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163513216:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667486:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746292.667512:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163513472 00000100:00100000:2.0:1788746292.667520:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163513472 00000100:00100000:2.0:1788746292.667565:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163513216 00000100:00100000:2.0:1788746292.667569:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163513216 00000100:00100000:2.0:1788746292.667595:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788746292.667605:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163513472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667654:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163513472:12345-0@lo:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.667676:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788746292.667697:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788746292.667704:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1875636163513216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667735:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1875636163513216:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.667740:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788746292.667770:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746292.667774:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746292.667802:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163513216:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667838:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163513472:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667858:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163513344 00000100:00100000:2.0:1788746292.667862:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163513344 00000100:00100000:2.0:1788746292.667891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163512960 00000100:00100000:2.0:1788746292.667894:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163512960 00000100:00100000:2.0:1788746292.667905:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163513088 00000100:00100000:2.0:1788746292.667908:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163513088 00000100:00100000:2.0:1788746292.667924:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788746292.667930:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163513344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.667966:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163513344:12345-0@lo:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.667972:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788746292.667985:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788746292.667991:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163512960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.668018:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163512960:12345-0@lo:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.668024:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788746292.668036:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788746292.668042:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163513088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.668072:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163513088:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.668078:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788746292.668093:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746292.668110:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163513088:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.668132:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788746292.668150:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163513344:0@lo:400:kworker.0 00000100:00100000:1.0:1788746292.668296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163512832 00000100:00100000:1.0:1788746292.668301:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163512832 00000100:00100000:1.0:1788746292.668335:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788746292.668342:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163512832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746292.668381:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163512832:12345-0@lo:400:kworker.0 Request processed in 39us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.668387:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788746292.668440:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163512832:0@lo:400:kworker.0 00000001:00080000:0.0:1788746292.712314:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788746292.712333:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1788746292.731426:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788746292.731789:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746292.731796:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746292.731844:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788746292.731855:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746292.732231:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d182680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163513600:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746292.732479:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746292.747482:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.747633:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d182680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163513600:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788746292.748100:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478784 00000100:00100000:1.0:1788746292.748107:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478784 00000100:00100000:1.0:1788746292.748163:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 112 00000100:00100000:1.0:1788746292.748173:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10528:x1875636141478784:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788746292.748240:0:5849:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788746292.748346:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10528:x1875636141478784:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 173us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.748354:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 112 00000100:00100000:1.0:1788746292.765073:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.765693:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141478912 00000100:00100000:3.0:1788746292.765715:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141478912 00000100:00100000:3.0:1788746292.765795:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 113 00000100:00100000:3.0:1788746292.765806:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10528:x1875636141478912:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788746292.765877:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765893:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765905:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765960:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765968:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765975:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.765996:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766005:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766011:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746292.766046:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788746292.766050:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746292.766069:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766080:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766087:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766095:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766101:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746292.766105:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766112:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766124:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:3.0:1788746292.766127:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746292.766132:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766138:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a157 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766151:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766157:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766163:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766175:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746292.766178:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766184:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766192:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9cd44773e600) 00010000:00010000:3.0:1788746292.766195:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746292.766197:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766202:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a15e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766215:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766221:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766227:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766232:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746292.766235:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766241:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766272:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746292.766275:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746292.766278:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.766284:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746292.766364:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10528:x1875636141478912:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 Request processed in 560us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.766372:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 113 00000100:00100000:0.0:1788746292.775307:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.775504:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141479168 00000100:00100000:1.0:1788746292.775513:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141479168 00000100:00100000:1.0:1788746292.775572:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:1.0:1788746292.775594:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:10528:x1875636141479168:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746292.775613:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.775633:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a16c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775740:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775762:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775774:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746292.775786:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788746292.775893:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775901:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775924:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775929:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746292.775933:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775941:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775953:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746292.775957:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746292.775961:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.775968:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.776009:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a16c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b398 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.776019:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:1.0:1788746292.776021:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746292.776025:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a16c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b398 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.776036:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400e00, rc 0) 00000100:00100000:1.0:1788746292.776096:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479168:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 505us (799us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1788746292.776112:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:1.0:1788746292.778973:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.779148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141479296 00000100:00100000:2.0:1788746292.779158:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141479296 00000100:00100000:2.0:1788746292.779212:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:2.0:1788746292.779222:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479296:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788746292.779285:0:5850:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788746292.779381:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479296:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 160us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.779389:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:3.0:1788746292.801080:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.801278:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141479552 00000100:00100000:1.0:1788746292.801287:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141479552 00000100:00100000:1.0:1788746292.801346:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:1.0:1788746292.801357:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479552:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746292.801378:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.801382:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788746292.801445:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b37c expref: 57 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.801469:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:1.0:1788746292.801474:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746292.801486:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a181 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b39f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746292.801869:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788746292.802049:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.802064:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.802075:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.802122:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a181 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b39f expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.802158:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b39f expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.802167:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad600) 00010000:00010000:1.0:1788746292.802170:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746292.802172:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401000, rc 0) 00000100:00100000:1.0:1788746292.802228:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10528:x1875636141479552:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 872us (1157us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788746292.802236:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:1.0:1788746292.816303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.824019:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141479808 00000100:00100000:2.0:1788746292.824034:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141479808 00000100:00100000:2.0:1788746292.824116:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:2.0:1788746292.824127:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10528:x1875636141479808:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746292.824182:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746292.824208:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b39f expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824231:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad600) 00010000:00010000:2.0:1788746292.824242:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746292.824262:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824276:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824304:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824342:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824351:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824358:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824466:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824474:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824481:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824486:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746292.824491:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824499:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824508:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746292.824511:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746292.824515:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824528:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a196 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824539:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824545:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824552:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824557:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746292.824560:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824566:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824574:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x713005e8 (ffff9cd46e1acf00) 00010000:00010000:2.0:1788746292.824588:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746292.824591:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.824598:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a19d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x713005e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746292.824670:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479808:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 545us (8375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746292.824678:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:0.0:1788746292.837111:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.837383:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141479936 00000100:00100000:1.0:1788746292.837392:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141479936 00000100:00100000:1.0:1788746292.837485:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:1.0:1788746292.837495:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:10528:x1875636141479936:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746292.837513:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.837537:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a1a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3a6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837572:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837585:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837597:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837700:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a1a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837733:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.837741:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:1.0:1788746292.837744:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788746292.837755:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401400, rc 0) 00000100:00100000:1.0:1788746292.837808:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10528:x1875636141479936:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 315us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.837815:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:1.0:1788746292.840379:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.850275:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141480192 00000100:00100000:2.0:1788746292.850289:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141480192 00000100:00100000:2.0:1788746292.850364:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:2.0:1788746292.850376:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:10528:x1875636141480192:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746292.850468:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.850484:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.850496:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746292.851105:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788746292.851115:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367255716167ns, next at 368255713852ns, rc = 0 00000004:00010000:2.0:1788746292.851195:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003c5c0639 reply state 000000004a50cd3d transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746292.851204:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746292.851357:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:10528:x1875636141480192:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 980us (10982us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788746292.851365:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 119 00010000:00010000:1.0:1788746292.853219:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853234:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853241:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853247:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746292.853252:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853259:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853292:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:1.0:1788746292.853295:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746292.853300:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.853306:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a1b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746292.853924:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.854442:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141480320 00000100:00100000:2.0:1788746292.854451:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141480320 00000100:00100000:2.0:1788746292.854505:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:2.0:1788746292.854516:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+59:10528:x1875636141480320:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746292.854537:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746292.854554:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3ad expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.857201:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.857222:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.857242:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:2.0:1788746292.857245:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746292.857248:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45600, rc 0) 00000100:00100000:2.0:1788746292.857315:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+60:10528:x1875636141480320:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 2801us (3394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.857323:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 120 00000100:00100000:0.0:1788746292.864736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.870079:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141480448 00000100:00100000:2.0:1788746292.870094:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141480448 00000100:00100000:2.0:1788746292.870189:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:2.0:1788746292.870199:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141480448:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788746292.870218:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746292.870603:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141480448:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 404us (5882us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788746292.870611:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:1.0:1788746292.888926:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.889083:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141480704 00000100:00100000:3.0:1788746292.889093:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141480704 00000100:00100000:3.0:1788746292.889152:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:3.0:1788746292.889162:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+60:10528:x1875636141480704:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746292.889449:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:10528:x1875636141480704:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 287us (530us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788746292.889458:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:1.0:1788746292.892958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.893132:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141480960 00000100:00100000:2.0:1788746292.893142:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141480960 00000100:00100000:2.0:1788746292.893200:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:2.0:1788746292.893210:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+61:10528:x1875636141480960:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788746292.893329:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+61:10528:x1875636141480960:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 120us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.893336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:0.0:1788746292.897441:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746292.897529:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481088 00000100:00100000:1.0:1788746292.897538:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481088 00000100:00100000:1.0:1788746292.897701:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 122 00000100:00100000:1.0:1788746292.897712:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:10528:x1875636141481088:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746292.897731:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746292.897759:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a1c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897820:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897834:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897845:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746292.897878:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746292.897909:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897933:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a1c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3b4 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897965:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3b4 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746292.897974:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:1.0:1788746292.897977:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788746292.897981:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401000, rc 0) 00000100:00100000:1.0:1788746292.898038:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+62:10528:x1875636141481088:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 328us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746292.898045:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 122 00000100:00100000:3.0:1788746292.906009:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746292.909394:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481216 00000100:00100000:0.0:1788746292.909432:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481216 00000100:00100000:0.0:1788746292.909489:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:0.0:1788746292.909501:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2349:x1875636141481216:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746292.909518:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746292.909537:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3bb expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746292.909563:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1a35, blocks: 0x1 00010000:00010000:0.0:1788746292.909593:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1788746292.909598:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746292.909608:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.909624:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746292.909650:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9c00, rc 0) 00000100:00100000:0.0:1788746292.909706:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141481216:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 208us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746292.909712:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:3.0:1788746292.911916:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.912040:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481472 00000100:00100000:2.0:1788746292.912056:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481472 00000100:00100000:2.0:1788746292.912106:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 123 00000100:00100000:2.0:1788746292.912116:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+62:10528:x1875636141481472:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788746292.912211:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+62:10528:x1875636141481472:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.912218:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 123 00000100:00100000:0.0:1788746292.918756:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.918840:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481600 00000100:00100000:3.0:1788746292.918849:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481600 00000100:00100000:3.0:1788746292.918899:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:3.0:1788746292.918909:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+10:10528:x1875636141481600:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746292.918927:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746292.918965:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3c2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.918996:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.919006:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746292.919011:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746292.919016:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.919046:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.919060:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746292.919073:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875636163513728:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746292.919162:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746292.931992:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875636163513728:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746292.932027:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746292.932048:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:2.0:1788746292.932105:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+11:10528:x1875636141481600:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 13196us (13365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746292.932114:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:1.0:1788746292.947348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.947523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481728 00000100:00100000:3.0:1788746292.947532:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481728 00010000:00010000:3.0:1788746292.947572:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746292.947624:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:3.0:1788746292.947634:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+11:2350:x1875636141481728:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746292.947664:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746292.947685:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.947699:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.947730:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf7aba8/0xe59b64da5b30a1ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3bb expref: 11 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.947754:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746292.947759:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746292.947767:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.947777:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746292.947813:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746292.947827:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875636163513856:192.168.206.24@tcp:105: 00000100:00100000:3.0:1788746292.947913:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746292.951282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746292.951385:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875636163513856:192.168.206.24@tcp:105: 00010000:00010000:3.0:1788746292.951432:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746292.951498:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2350:x1875636141481728:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 3864us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746292.951508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:2.0:1788746292.951673:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481856 00000100:00100000:2.0:1788746292.951681:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481856 00002000:00100000:2.0:1788746292.951717:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cd45f550380 x1875636141481856/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:303/0 lens 504/0 e 0 to 0 dl 1788746303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746292.951734:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f550380 with x1875636141481856 ext(0->12) 00002000:00010000:2.0:1788746292.951739:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f550380 00000100:00100000:2.0:1788746292.951773:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:2.0:1788746292.951783:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141481856:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788746292.952172:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+12:2349:x1875636141481856:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 Request processed in 390us (898us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788746292.952188:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00002000:00100000:2.0:1788746292.952195:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cd45f550380 x1875636141481856/t4294967308(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:303/0 lens 504/448 e 0 to 0 dl 1788746303 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746292.952203:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f550380 with x1875636141481856 ext(0->12) 00002000:00010000:2.0:1788746292.952207:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f550380 00000100:00100000:0.0:1788746292.957010:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746292.958694:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141481984 00000100:00100000:2.0:1788746292.958707:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141481984 00000100:00100000:2.0:1788746292.958790:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 124 00000100:00100000:2.0:1788746292.958801:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+62:10528:x1875636141481984:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788746293.014475:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000020:00080000:1.0:1788746293.014496:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd47764a3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788746293.014501:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4508a6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd47764a480 00000020:00080000:1.0:1788746293.014505:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4508a6f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd47d1e2400 00000001:00080000:1.0:1788746293.014521:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1788746293.014534:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788746293.014558:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788746293.014565:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788746293.014568:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788746293.014801:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+43:10528:x1875636141481984:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 Request processed in 55997us (57794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746293.014811:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 124 00000004:00080000:1.0:1788746293.014927:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788746293.014952:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd44744e180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788746293.014956:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd442c2ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd44744e0c0 00000020:00080000:1.0:1788746293.014974:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd442c2e800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd47d0fa000 00000001:00080000:1.0:1788746293.014996:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:1.0:1788746293.015036:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788746293.015371:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788746293.015524:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163514112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788746293.015732:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163513984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788746293.015973:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163514240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788746293.016029:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746293.016606:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746293.017012:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746293.017079:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163514112 00000100:00100000:0.0:1788746293.017087:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163514112 00000100:00100000:0.0:1788746293.017260:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163513984 00000100:00100000:0.0:1788746293.017264:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163513984 00000100:00100000:0.0:1788746293.017305:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163514240 00000100:00100000:0.0:1788746293.017309:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163514240 00000100:00100000:0.0:1788746293.017324:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788746293.017332:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163513984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788746293.017356:0:8456:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788746293.017379:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.017418:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.017428:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788746293.017443:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788746293.017448:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.017481:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.017496:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 11 pid: 6680 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746293.017510:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163514368:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746293.017679:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746293.017689:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163514240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788746293.017704:0:6681:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788746293.017745:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e1a34, atime: 0x6a9e1a34, ctime: 0x6a9e1a34, blocks: 0xb 00010000:00010000:3.0:1788746293.017760:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.017769:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788746293.017773:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746293.017779:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.017794:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.017803:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.017810:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.017829:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788746293.018384:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163514240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 696us (1370us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788746293.018392:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746293.018457:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788746293.018463:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788746293.018478:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd48001df80, transno 4294967301 00000004:00080000:3.0:1788746293.018487:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788746293.018499:0:3314:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cd45f550000 x1875636163514240/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788746309 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788746293.018510:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45f550000/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788746293.018514:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163514240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788746293.018894:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746293.018905:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163514112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788746293.019022:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788746293.019025:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788746293 00002000:00010000:2.0:1788746293.019028:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788746293.019030:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788746293 -> 1788746293 00002000:00010000:2.0:1788746293.019033:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788746293.019076:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1875636163514112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (3046us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788746293.019083:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788746293.019159:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764ab40 going to sleep for 11 seconds 00010000:00010000:1.0:1788746293.019826:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746293.019835:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.019847:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746293.019850:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.019861:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.019880:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.019888:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a1e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.019907:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746293.019909:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746293.019911:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788746293.019941:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd47d76c380/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788746293.019957:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163514112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788746293.020095:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.021562:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141482112 00000100:00100000:1.0:1788746293.021583:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141482112 00000100:00100000:1.0:1788746293.021639:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:1.0:1788746293.021650:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+12:2347:x1875636141482112:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788746293.041097:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.041132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141482240 00000100:00100000:1.0:1788746293.041141:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141482240 00010000:00010000:1.0:1788746293.041191:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 13 pid: 6680 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.041243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 54 00000100:00100000:1.0:1788746293.041253:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141482240:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746293.041268:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746293.041274:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 13 pid: 6680 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.041287:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 13 pid: 6680 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.041313:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746293.041317:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746293.041323:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.041333:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.041366:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746293.041429:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141482240:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 177us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746293.041436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 54 00010000:00010000:0.0:1788746293.041877:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a515bb6/0xe59b64da5b309f9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b321 expref: 12 pid: 6680 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746293.041893:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163514368:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746293.041914:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.041923:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.041929:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.041951:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.041958:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.041980:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788746293.042564:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1875636163513984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25231us (25957us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788746293.042723:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788746293.042808:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd47d76ed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788746293.042814:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163513984:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788746293.043005:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746293.043012:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.043021:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746293.043025:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.043034:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.043051:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.043057:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ca45d0/0xe59b64da5b30a1dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.043076:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746293.043078:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746293.043079:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788746293.058031:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788746293.058051:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788746293.058068:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788746293.058257:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141482112:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 Request processed in 36604us (38158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746293.058269:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:1.0:1788746293.064520:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746293.064682:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141482496 00000100:00100000:2.0:1788746293.064692:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141482496 00000100:00100000:2.0:1788746293.064790:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 125 00000100:00100000:2.0:1788746293.064800:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10528:x1875636141482496:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746293.064865:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746293.064893:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a1c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3b4 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.064918:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:2.0:1788746293.064923:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746293.065133:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.065148:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.065159:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746293.065374:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007801f95a reply state 00000000798023e9 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.065384:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1788746293.065652:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746293.065695:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:10528:x1875636141482496:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 895us (1182us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788746293.065703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 125 00000100:00100000:1.0:1788746293.068852:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746293.069123:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141482624 00000100:00100000:3.0:1788746293.069132:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141482624 00000100:00100000:3.0:1788746293.069192:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:3.0:1788746293.069202:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141482624:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788746293.069449:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788746293.069454:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788746293 -> 1788746292 00002000:00010000:3.0:1788746293.069456:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788746292 00002000:00010000:3.0:1788746293.069459:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788746293 -> 1788746292 00002000:00010000:3.0:1788746293.069461:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788746293.069520:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141482624:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 318us (675us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788746293.069528:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 44 00010000:00010000:0.0:1788746293.070753:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070767:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070774:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070781:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746293.070797:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070804:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070818:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:0.0:1788746293.070822:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746293.070826:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.070832:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44000/0xe59b64da5b30a1ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.073206:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.073289:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141482880 00000100:00100000:1.0:1788746293.073298:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141482880 00000100:00100000:1.0:1788746293.073357:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 126 00000100:00100000:1.0:1788746293.073367:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:10528:x1875636141482880:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788746293.073474:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.073492:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.073500:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.073533:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.073546:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 15 pid: 5849 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.073560:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163514496:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746293.073629:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746293.076659:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746293.076744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483008 00000100:00100000:3.0:1788746293.076760:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483008 00010000:00010000:3.0:1788746293.076791:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 16 pid: 5849 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746293.076847:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:3.0:1788746293.076858:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:2349:x1875636141483008:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746293.076884:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746293.076892:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 16 pid: 5849 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.076904:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 16 pid: 5849 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.076925:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:3.0:1788746293.076930:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.076938:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.076958:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.076975:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746293.077021:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:2349:x1875636141483008:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 165us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746293.077028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 55 00010000:00010000:2.0:1788746293.077222:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a1ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3a6 expref: 15 pid: 5849 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.077243:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163514496:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746293.077263:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077278:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077284:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077309:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077315:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077322:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077328:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746293.077332:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077339:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077349:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:2.0:1788746293.077351:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788746293.077354:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.077360:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.077448:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10528:x1875636141482880:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 Request processed in 4033us (4204us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788746293.077463:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 126 00000100:00100000:2.0:1788746293.080799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746293.081122:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483136 00000100:00100000:0.0:1788746293.081131:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483136 00000100:00100000:0.0:1788746293.081188:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:0.0:1788746293.081198:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141483136:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788746293.081248:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.081268:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.081277:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746293.081281:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788746293.081286:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.081321:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.081346:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 7 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746293.081359:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163514624:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746293.081731:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746293.086220:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163514624:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746293.086259:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.086349:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.086432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483264 00000100:00100000:1.0:1788746293.086438:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483264 00010000:00010000:1.0:1788746293.086471:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.086510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00100000:1.0:1788746293.086520:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141483264:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746293.086533:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746293.086555:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.086567:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.086589:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a1d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c2 expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.086604:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746293.086609:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746293.086614:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.086623:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.086667:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746293.086715:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141483264:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 197us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746293.086722:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 56 00010000:00010000:2.0:1788746293.086854:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086873:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086898:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086907:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086915:0:8456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086921:0:8456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746293.086925:0:8456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086933:0:8456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086957:0:8456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.086972:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f49dfa/0xe59b64da5b30a1f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.087016:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141483136:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 Request processed in 5819us (6224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746293.087023:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:3.0:1788746293.090247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.090304:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483520 00000100:00100000:1.0:1788746293.090314:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483520 00000100:00100000:1.0:1788746293.090367:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 127 00000100:00100000:1.0:1788746293.090377:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10528:x1875636141483520:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788746293.090475:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090492:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090503:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090736:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090757:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090766:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090797:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.090820:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 15 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.090833:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163514752:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746293.091266:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746293.094707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746293.095160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483648 00000100:00100000:0.0:1788746293.095169:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483648 00010000:00010000:0.0:1788746293.095207:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 16 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746293.095258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:0.0:1788746293.095268:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:2350:x1875636141483648:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746293.095283:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746293.095289:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 16 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.095303:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 16 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.095323:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:0.0:1788746293.095329:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.095338:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.095360:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.095380:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746293.095573:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+16:2350:x1875636141483648:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 306us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746293.095581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 57 00010000:00010000:1.0:1788746293.096648:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a1b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ad expref: 15 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.096668:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163514752:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746293.096687:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.096697:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.096703:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788746293.097178:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788746293.097374:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788746293.097562:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788746293.097640:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1875636163514880:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788746293.097694:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746293.097874:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870900 going to sleep for 11 seconds 00000100:00100000:2.0:1788746293.098044:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163514880 00000100:00100000:2.0:1788746293.098051:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163514880 00000100:00100000:2.0:1788746293.098142:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746293.098153:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1875636163514880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788746293.098247:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1875636163514880:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746293.098254:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746293.098318:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788746293.098323:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788746293.098337:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd47d76c380, transno 4294967309 00000100:00100000:1.0:1788746293.098377:0:5851:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cd47d76ed80 x1875636163513984/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788746309 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746293.098389:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1875636163514880:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788746293.098863:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788746293.098938:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1875636163515008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788746293.099300:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746293.100157:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746293.100188:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163515008 00000100:00100000:0.0:1788746293.100195:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163515008 00000100:00100000:0.0:1788746293.100320:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746293.100331:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1875636163515008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788746293.100814:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5851:x1875636163515008:12345-0@lo:1000:mdt00_002.0 Request processed in 484us (1512us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788746293.100824:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746293.101066:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1875636163515008:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788746293.101103:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101113:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101120:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101126:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746293.101130:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101137:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101151:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd4511ad800) 00010000:00010000:1.0:1788746293.101154:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788746293.101158:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101164:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a206 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101210:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101216:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101222:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101227:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746293.101230:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101235:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101243:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746293.101245:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788746293.101252:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101262:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101271:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.101300:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.101323:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163515136:192.168.206.24@tcp:105: 00000100:00100000:1.0:1788746293.101521:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4558706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746293.104373:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746293.104531:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141483776 00000100:00100000:0.0:1788746293.104539:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141483776 00000100:00100000:0.0:1788746293.104589:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:0.0:1788746293.104598:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10527:x1875636141483776:12345-192.168.206.24@tcp:49:lfs.0 00000100:00100000:0.0:1788746293.104852:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10527:x1875636141483776:12345-192.168.206.24@tcp:49:lfs.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746293.104860:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:3.0:1788746293.107046:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163515136:192.168.206.24@tcp:105: 00010000:00010000:3.0:1788746293.107093:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107104:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a149 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107134:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107147:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107158:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107168:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107173:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107179:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107184:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746293.107187:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107194:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107204:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746293.107208:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746293.107218:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107224:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a20d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107234:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107241:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107246:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107251:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746293.107254:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107260:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107268:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746293.107271:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746293.107274:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746293.107279:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a1ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746293.110821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.110958:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484032 00000100:00100000:1.0:1788746293.110968:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484032 00000100:00100000:1.0:1788746293.111028:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 128 00000100:00100000:1.0:1788746293.111038:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10527:x1875636141484032:12345-192.168.206.24@tcp:58:lfs.0 00000040:00080000:3.0:1788746293.112105:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746293.112111:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746293.112655:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788746293.112673:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788746293.113035:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:10528:x1875636141483520:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 22655us (22791us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1788746293.113047:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 127 00000020:00080000:2.0:1788746293.113053:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788746293.113201:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788746293.113267:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+18:10527:x1875636141484032:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 2230us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746293.113275:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 128 00000100:00100000:3.0:1788746293.116677:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746293.118120:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484288 00000100:00100000:2.0:1788746293.118132:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484288 00000100:00100000:2.0:1788746293.118197:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:2.0:1788746293.118208:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450d30850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+18:10528:x1875636141484288:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788746293.119620:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788746293.121024:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1788746293.121101:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121134:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121147:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121156:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121163:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121170:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.121273:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788746293.121385:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450d30850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:10528:x1875636141484288:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 3175us (4712us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788746293.121395:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 32 00000020:00080000:2.0:1788746293.121430:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788746293.127221:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746293.127247:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.127259:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746293.127264:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.127273:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.127291:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cd46e1acf00) 00010000:00010000:0.0:1788746293.127294:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788746293.127298:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.127305:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a214 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746293.127327:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746293.127329:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746293.127331:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746293.150124:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746293.150687:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484416 00000100:00100000:2.0:1788746293.150697:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484416 00000100:00100000:2.0:1788746293.150950:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 129 00000100:00100000:2.0:1788746293.150961:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:10530:x1875636141484416:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746293.150985:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746293.151005:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a21b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3c9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151063:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151090:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151102:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151117:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151124:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151130:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151379:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151391:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151419:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151451:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.151464:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 21 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.151489:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb47480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163515264:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746293.151624:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746293.155178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746293.155256:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484672 00000100:00100000:3.0:1788746293.155266:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484672 00000100:00100000:3.0:1788746293.155319:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:3.0:1788746293.155328:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+22:5588:x1875636141484672:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788746293.155561:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:5588:x1875636141484672:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 233us (391us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788746293.155568:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:0.0:1788746293.157549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746293.157639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484800 00000100:00100000:1.0:1788746293.157647:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484800 00010000:00010000:1.0:1788746293.157682:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 23 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746293.157721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:1.0:1788746293.157742:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:2350:x1875636141484800:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746293.157766:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746293.157773:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 23 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.157786:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 23 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.157807:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746293.157813:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.157842:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.157850:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746293.157880:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746293.157930:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:2350:x1875636141484800:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746293.157937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 58 00010000:00010000:2.0:1788746293.159420:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a13b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b38a expref: 22 pid: 8618 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746293.159444:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb47480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163515264:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746293.159468:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159478:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159483:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746293.159523:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788746293.159527:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746293.159545:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159558:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159567:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159575:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159598:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159604:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746293.159608:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159615:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159628:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746293.159631:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746293.159635:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159641:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159652:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159658:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159664:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159669:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746293.159672:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159687:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159695:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cd46e1ace00) 00010000:00010000:2.0:1788746293.159697:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746293.159701:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159706:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159818:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a21b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c9 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159832:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c9 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746293.159840:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746293.159843:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746293.159845:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746293.160236:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10530:x1875636141484416:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 9267us (10111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746293.160245:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 129 00000100:00100000:3.0:1788746293.178687:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163515392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746293.178767:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746293.178846:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163515392 00000100:00100000:2.0:1788746293.178854:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163515392 00000100:00100000:2.0:1788746293.178912:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746293.178920:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163515392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746293.178939:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788746293.178999:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163515392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746293.179006:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788746293.179145:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163515392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746293.754921:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788746294.084337:0:12041:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746294.084345:0:12041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746294.084386:0:12041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788746294.084391:0:12041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788746294.140367:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746294.140374:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746294.140445:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788746294.140453:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788746294.140566:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb45880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163515520:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788746294.140650:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746294.163036:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb45880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163515520:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788746294.163056:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746294.163170:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141484928 00000100:00100000:2.0:1788746294.163176:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141484928 00000100:00100000:2.0:1788746294.163504:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 130 00000100:00100000:2.0:1788746294.163518:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10542:x1875636141484928:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788746294.163559:0:5851:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788746294.163820:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10542:x1875636141484928:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 304us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746294.172196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 130 00000100:00100000:3.0:1788746294.173278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746294.176119:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141485184 00000100:00100000:2.0:1788746294.176131:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141485184 00000100:00100000:2.0:1788746294.176319:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 131 00000100:00100000:2.0:1788746294.176330:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+21:10542:x1875636141485184:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746294.176349:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746294.176368:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a237 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3d0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.176494:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.176508:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.176521:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746294.176532:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788746294.176640:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a237 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d0 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.176655:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d0 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.176662:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746294.176665:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746294.176669:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746294.176752:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:10542:x1875636141485184:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 424us (3477us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788746294.176761:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 131 00000100:00100000:2.0:1788746294.225558:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746294.225590:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746294.225623:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141485440 00000100:00100000:2.0:1788746294.225631:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141485440 00000100:00100000:2.0:1788746294.225679:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 132 00000100:00100000:2.0:1788746294.225688:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+23:10542:x1875636141485440:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788746294.225774:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.225790:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.225801:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746294.225835:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141485568 00000100:00100000:1.0:1788746294.225840:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141485568 00000100:00100000:1.0:1788746294.225995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:1.0:1788746294.226003:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+25:2349:x1875636141485568:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746294.226014:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746294.226030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d0 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746294.226043:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:1.0:1788746294.226047:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746294.226090:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141485568:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 87us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746294.226097:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00010000:00010000:2.0:1788746294.226144:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226153:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226160:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226165:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746294.226169:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226176:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226184:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746294.226187:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746294.226191:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746294.226197:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a24c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746294.226472:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+23:10542:x1875636141485440:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 784us (921us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788746294.226479:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 132 00000040:00080000:2.0:1788746294.226579:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746294.226583:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746294.230922:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788746294.230938:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746294.235451:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746294.236169:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141485824 00000100:00100000:3.0:1788746294.236180:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141485824 00000100:00100000:3.0:1788746294.236235:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:3.0:1788746294.236245:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:10542:x1875636141485824:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746294.236475:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+24:10542:x1875636141485824:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 231us (1030us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788746294.236482:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 34 00010000:00010000:1.0:1788746294.778638:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746294.816902:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746294.816942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746294.816970:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746294.817015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746294.817079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141485952 00000100:00100000:0.0:1788746294.817088:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141485952 00000100:00100000:0.0:1788746294.817139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 289 00000100:00100000:0.0:1788746294.817158:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141485952:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746294.817221:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141485952:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746294.817228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 289 00000100:00100000:2.0:1788746294.817435:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486336 00000100:00100000:2.0:1788746294.817440:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486336 00000100:00100000:2.0:1788746294.817477:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 137 00000100:00100000:2.0:1788746294.817484:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141486336:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746294.817523:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141486336:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 38us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746294.817529:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 137 00000100:00100000:2.0:1788746294.817555:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486080 00000100:00100000:2.0:1788746294.817559:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486080 00000100:00100000:2.0:1788746294.817582:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486208 00000100:00100000:2.0:1788746294.817584:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486208 00000100:00100000:2.0:1788746294.817604:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:2.0:1788746294.817611:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141486080:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746294.817636:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141486080:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746294.817642:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:2.0:1788746294.817655:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:2.0:1788746294.817661:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141486208:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746294.817692:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141486208:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 32us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746294.817698:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00080000:0.0:1788746294.817861:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746294.817865:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746294.817867:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746295.739685:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163515648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746295.739765:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746295.739913:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163515648 00000100:00100000:2.0:1788746295.739921:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163515648 00000100:00100000:2.0:1788746295.739981:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746295.739989:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163515648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746295.740017:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746295.740055:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163515648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746295.740062:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788746295.740954:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746295.740995:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163515648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746295.806876:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788746296.433383:0:12092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746296.433391:0:12092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746296.433889:0:12092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788746296.433896:0:12092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788746296.668252:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746296.668373:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486592 00000100:00100000:0.0:1788746296.668382:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486592 00000100:00100000:0.0:1788746296.668465:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 133 00000100:00100000:0.0:1788746296.668475:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+24:10563:x1875636141486592:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746296.668506:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746296.668525:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3d7 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746296.668606:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30a25a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746296.668620:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30a25a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746296.668632:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30a25a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746296.668643:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788746296.668776:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d7 expref: 27 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746296.668794:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30a25a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d7 expref: 26 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746296.668802:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:0.0:1788746296.668805:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788746296.668808:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9200, rc 0) 00000100:00100000:0.0:1788746296.668869:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+26:10563:x1875636141486592:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 395us (635us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788746296.668876:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 133 00000100:00080000:3.0:1788746296.669740:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746296.675131:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746296.676042:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486720 00000100:00100000:3.0:1788746296.676051:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486720 00000100:00100000:3.0:1788746296.676105:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 134 00000100:00100000:3.0:1788746296.676114:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:10563:x1875636141486720:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:3.0:1788746296.676171:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676188:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676199:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676221:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676227:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676234:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676240:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746296.676243:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676251:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676261:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:3.0:1788746296.676264:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746296.676277:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746296.676283:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746296.676338:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:10563:x1875636141486720:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 225us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746296.676345:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 134 00000100:00100000:0.0:1788746296.791710:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746296.791900:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486848 00000100:00100000:2.0:1788746296.791910:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486848 00000100:00100000:2.0:1788746296.791974:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:2.0:1788746296.791983:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141486848:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:2.0:1788746296.791999:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746296.792017:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e34f1b/0xe59b64da5b30a26f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3de expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746296.792040:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e1a34, atime: 0x6a9e1a34, ctime: 0x6a9e1a34, blocks: 0xb 00010000:00010000:2.0:1788746296.792057:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00000100:00080000:3.0:1788746296.792503:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788746296.792637:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746296.792649:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e34f1b/0xe59b64da5b30a26f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3de expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746296.792681:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e34f1b/0xe59b64da5b30a26f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3de expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746296.792695:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44000, rc 0) 00000100:00100000:3.0:1788746296.792948:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2348:x1875636141486848:12345-192.168.206.24@tcp:101:cat.0 Request processed in 963us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746296.792955:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:2.0:1788746296.796780:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746296.796846:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141486976 00000100:00100000:0.0:1788746296.796855:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141486976 00002000:00100000:0.0:1788746296.796902:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9cd45fb47480 x1875636141486976/t0(0) o3->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:307/0 lens 488/0 e 0 to 0 dl 1788746307 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788746296.796914:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45fb47480 with x1875636141486976 ext(0->4095) 00002000:00010000:0.0:1788746296.796919:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45fb47480 00000100:00100000:0.0:1788746296.796947:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:0.0:1788746296.796955:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141486976:12345-192.168.206.24@tcp:3:cat.0 00000100:00100000:0.0:1788746296.797166:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141486976:12345-192.168.206.24@tcp:3:cat.0 Request processed in 211us (393us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788746296.797174:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00002000:00100000:0.0:1788746296.797180:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9cd45fb47480 x1875636141486976/t0(0) o3->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:307/0 lens 488/4536 e 0 to 0 dl 1788746307 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788746296.797200:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45fb47480 with x1875636141486976 ext(0->4095) 00002000:00010000:0.0:1788746296.797203:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45fb47480 00010000:00010000:0.0:1788746296.826834:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746297.790626:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163515776:0@lo:400:kworker.0 00000100:00100000:1.0:1788746297.790701:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746297.790896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163515776 00000100:00100000:2.0:1788746297.790904:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163515776 00000100:00100000:2.0:1788746297.790960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788746297.790969:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163515776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807443:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163516160:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807500:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746297.807532:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746297.807537:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163516288:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807557:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746297.807594:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163515904:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807615:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746297.807853:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163516416:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807881:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746297.807901:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746297.807906:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163516032:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.807924:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746297.807974:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516160 00000100:00100000:0.0:1788746297.807980:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516160 00000100:00100000:0.0:1788746297.808021:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516416 00000100:00100000:0.0:1788746297.808023:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516416 00000100:00100000:0.0:1788746297.808042:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788746297.808050:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163516160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808090:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163516160:12345-0@lo:400:kworker.0 Request processed in 40us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746297.808096:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788746297.808112:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746297.808128:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163516416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808157:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163516416:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746297.808162:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746297.808177:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516288 00000100:00100000:0.0:1788746297.808180:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516288 00000100:00100000:0.0:1788746297.808198:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163515904 00000100:00100000:0.0:1788746297.808200:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163515904 00000100:00100000:0.0:1788746297.808208:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516032 00000100:00100000:0.0:1788746297.808210:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516032 00000100:00100000:0.0:1788746297.808222:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788746297.808227:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163516288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808252:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163516288:12345-0@lo:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746297.808257:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788746297.808266:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788746297.808271:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808290:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163515904:12345-0@lo:400:kworker.0 Request processed in 19us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746297.808295:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788746297.808304:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788746297.808309:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163516032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808327:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163516032:12345-0@lo:400:kworker.0 Request processed in 19us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746297.808333:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1788746297.808352:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788746297.808356:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746297.808364:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746297.808394:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163516288:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808426:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163516160:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163516032:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808457:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163515904:0@lo:400:kworker.0 00000100:00100000:0.0:1788746297.808464:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788746297.811431:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163515776:12345-0@lo:400:kworker.0 Request processed in 20457us (20731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746297.811444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788746297.819327:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163515776:0@lo:400:kworker.0 00010000:00010000:1.0:1788746297.851869:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788746297.870176:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:2.0:1788746298.304297:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746298.304317:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163516544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746298.304375:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746298.304454:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516544 00000100:00100000:2.0:1788746298.304461:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516544 00000100:00100000:2.0:1788746298.304505:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788746298.304513:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163516544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746298.304558:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746298.304612:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163516544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746298.304619:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788746298.304669:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163516544:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788746298.392177:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788746298.392200:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788746298.407246:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788746298.410537:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd455870900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788746298.410556:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd45fa82a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd455870f00 00000020:00080000:0.0:1788746298.410559:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd45fa82f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd45f658800 00000020:00080000:0.0:1788746298.410580:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788746298.410646:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788746298.410864:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788746298.876930:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746299.902849:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746299.932456:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746299.932485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746299.932506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746299.932525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746299.932542:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746299.932565:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487616 00000100:00100000:0.0:1788746299.932573:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487616 00000100:00100000:0.0:1788746299.932620:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487232 00000100:00100000:0.0:1788746299.932622:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487232 00000100:00100000:0.0:1788746299.932641:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 141 00000100:00100000:0.0:1788746299.932649:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141487616:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746299.932735:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141487616:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746299.932754:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 141 00000100:00100000:0.0:1788746299.932770:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 142 00000100:00100000:0.0:1788746299.932777:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2348:x1875636141487232:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746299.932799:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2348:x1875636141487232:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746299.932805:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 142 00000100:00100000:0.0:1788746299.932833:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487360 00000100:00100000:0.0:1788746299.932836:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487360 00000100:00100000:0.0:1788746299.932857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487488 00000100:00100000:0.0:1788746299.932860:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487488 00000100:00100000:0.0:1788746299.932875:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:0.0:1788746299.932880:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141487360:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746299.932901:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141487360:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 21us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746299.932907:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:0.0:1788746299.932916:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 83 00000100:00100000:0.0:1788746299.932922:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141487488:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746299.932938:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141487488:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 17us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746299.932943:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 83 00000100:00080000:0.0:1788746299.932954:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746299.932957:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746299.932959:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746299.933250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487104 00000100:00100000:1.0:1788746299.933254:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487104 00000100:00100000:1.0:1788746299.933368:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 291 00000100:00100000:1.0:1788746299.933375:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141487104:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746299.933414:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141487104:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 40us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746299.933420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 291 00000040:00080000:3.0:1788746300.410691:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746300.410701:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746300.410752:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788746300.410759:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746300.860252:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163516672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746300.860327:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746300.860695:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516672 00000100:00100000:3.0:1788746300.860713:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516672 00000100:00100000:2.0:1788746300.861924:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788746300.861942:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163516672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746300.861979:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746300.862059:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163516672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746300.862068:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788746300.862322:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746300.862779:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788746300.862786:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45f550000, transno 4294967304 00000100:00100000:1.0:1788746300.862817:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163516672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788746300.923628:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746301.952873:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746302.431517:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746302.432301:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141487744 00000100:00100000:0.0:1788746302.432311:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141487744 00000100:00100000:0.0:1788746302.432445:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 135 00000100:00100000:0.0:1788746302.432458:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10216:x1875636141487744:12345-192.168.206.24@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788746302.432639:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746302.433041:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10216:x1875636141487744:12345-192.168.206.24@tcp:60:lhsmtool_posix.0 Request processed in 584us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746302.433050:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 135 00000100:00100000:0.0:1788746302.447231:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746302.452352:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488000 00000100:00100000:3.0:1788746302.452368:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488000 00000100:00100000:3.0:1788746302.452873:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:3.0:1788746302.452886:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:10216:x1875636141488000:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746302.453209:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+14:10216:x1875636141488000:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 327us (5985us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788746302.453218:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:1.0:1788746302.907510:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163516800:0@lo:400:kworker.0 00000100:00100000:2.0:1788746302.907520:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163516928:0@lo:400:kworker.0 00000100:00100000:0.0:1788746302.907581:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163517184:0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.907632:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163517056:0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.913654:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746302.913748:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163517312:0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.913785:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746302.913951:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517312 00000100:00100000:1.0:1788746302.913959:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517312 00000100:00100000:1.0:1788746302.914015:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788746302.914024:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163517312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.914075:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163517312:12345-0@lo:400:kworker.0 Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746302.914083:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788746302.914103:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746302.914129:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163517312:0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.914212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516800 00000100:00100000:1.0:1788746302.914217:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516800 00000100:00100000:2.0:1788746302.915250:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746302.915351:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746302.915412:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517184 00000100:00100000:0.0:1788746302.915418:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517184 00000100:00100000:2.0:1788746302.915658:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163517440:0@lo:400:kworker.0 00000100:00100000:2.0:1788746302.915688:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746302.915729:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517440 00000100:00100000:2.0:1788746302.915732:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517440 00000100:00100000:3.0:1788746302.920009:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746302.920388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788746302.920424:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163516800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.920903:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3317:x1875636163516800:12345-0@lo:400:kworker.0 Request processed in 89us (6840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746302.920912:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788746302.920954:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163516928 00000100:00100000:3.0:1788746302.920962:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163516928 00000100:00100000:3.0:1788746302.920995:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517056 00000100:00100000:3.0:1788746302.920998:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517056 00000100:00100000:1.0:1788746302.925555:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163516800:0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.925604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788746302.925620:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163516928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746302.925717:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163516928:12345-0@lo:400:kworker.0 Request processed in 103us (10468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746302.925724:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788746302.927540:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788746302.927567:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163517184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746302.927652:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163517184:12345-0@lo:400:kworker.0 Request processed in 102us (12300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746302.927658:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788746302.927723:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163517184:0@lo:400:kworker.0 00000100:00100000:2.0:1788746302.933531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.934818:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788746302.934832:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163517056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.934922:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163517056:12345-0@lo:400:kworker.0 Request processed in 92us (14919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746302.934929:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788746302.934969:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163517056:0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.935028:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788746302.935035:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163517440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746302.935072:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163517440:12345-0@lo:400:kworker.0 Request processed in 39us (19384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746302.935079:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788746302.935110:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788746302.935115:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd47d76ed80, transno 4294967310 00000004:00080000:3.0:1788746302.935125:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788746302.935145:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163517440:0@lo:400:kworker.0 00000100:00080000:1.0:1788746302.940789:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746302.940799:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746302.940802:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788746302.973731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746303.418801:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746303.418835:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163517568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746303.418926:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746303.419415:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517568 00000100:00100000:2.0:1788746303.419424:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517568 00000100:00100000:2.0:1788746303.419478:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746303.419487:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163517568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746303.419519:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746303.419567:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163517568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746303.419574:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746303.419623:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163517568:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1788746303.502787:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1788746303.502825:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788746303.503040:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788746303.503051:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788746303.994840:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746305.020650:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746305.042313:0:12293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:58:23 (1788746303) 00000100:00100000:0.0:1788746305.054337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746305.054381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746305.054430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746305.054451:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746305.054507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746305.054536:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488512 00000100:00100000:0.0:1788746305.054546:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488512 00000100:00100000:0.0:1788746305.054601:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488384 00000100:00100000:0.0:1788746305.054605:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488384 00000100:00100000:0.0:1788746305.054634:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00100000:0.0:1788746305.054644:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141488512:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746305.054744:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141488512:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746305.054751:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00100000:0.0:1788746305.054767:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:0.0:1788746305.054773:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141488384:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746305.054797:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141488384:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746305.054802:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:0.0:1788746305.056225:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488256 00000100:00100000:0.0:1788746305.056236:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488256 00000100:00100000:0.0:1788746305.056288:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488640 00000100:00100000:0.0:1788746305.056291:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488640 00000100:00100000:0.0:1788746305.056317:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 146 00000100:00100000:0.0:1788746305.056326:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141488256:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746305.056391:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141488256:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 66us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746305.056413:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 146 00000100:00100000:0.0:1788746305.056431:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 147 00000100:00100000:0.0:1788746305.056437:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141488640:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746305.056477:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2349:x1875636141488640:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 40us (1969us total) trans 0 rc 0/0 00000100:00080000:1.0:1788746305.057328:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746305.057335:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746305.057339:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746305.057941:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 147 00000100:00100000:0.0:1788746305.057974:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488128 00000100:00100000:0.0:1788746305.057981:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488128 00000100:00100000:0.0:1788746305.058014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 293 00000100:00100000:0.0:1788746305.058021:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141488128:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746305.058949:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141488128:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 924us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746305.058959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 293 00000100:00100000:1.0:1788746305.980930:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746305.980952:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163517696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746305.981017:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746305.981843:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517696 00000100:00100000:2.0:1788746305.981866:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517696 00000100:00100000:2.0:1788746305.981937:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788746305.981947:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163517696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746305.981982:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746305.982099:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163517696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746305.982106:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788746305.988810:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746305.997702:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163517696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788746306.043180:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746306.794482:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746306.794556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141488896 00000100:00100000:3.0:1788746306.794565:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141488896 00000100:00100000:3.0:1788746306.794622:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 136 00000100:00100000:3.0:1788746306.794633:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:11275:x1875636141488896:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746306.794663:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746306.794692:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a276 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3e5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794771:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794784:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794798:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794813:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794820:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.794826:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795101:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a28b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795110:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a28b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795116:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a28b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746306.795126:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788746306.795255:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795262:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795268:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795274:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746306.795278:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795285:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795296:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd46e1ac900) 00010000:00010000:3.0:1788746306.795299:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746306.795314:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795331:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a27d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795344:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795350:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795355:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795360:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746306.795363:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795369:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795377:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cd44773e900) 00010000:00010000:3.0:1788746306.795379:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746306.795382:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795387:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a284 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795862:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a276 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3e5 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795877:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a28b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3e5 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746306.795890:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:3.0:1788746306.795893:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746306.795895:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940400, rc 0) 00000100:00100000:3.0:1788746306.795961:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:11275:x1875636141488896:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 1329us (1497us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788746306.795969:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 136 00000100:00100000:3.0:1788746306.803820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746306.803865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746306.803996:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489024 00000100:00100000:0.0:1788746306.804005:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489024 00000100:00100000:0.0:1788746306.804071:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:0.0:1788746306.804081:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+15:2347:x1875636141489024:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746306.804094:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746306.804115:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a28b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3e5 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746306.804134:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:0.0:1788746306.804140:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746306.804189:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2347:x1875636141489024:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746306.804197:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746306.810741:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489152 00000100:00100000:1.0:1788746306.810867:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489152 00000100:00100000:1.0:1788746306.811030:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 137 00000100:00100000:1.0:1788746306.811040:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+14:11275:x1875636141489152:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788746306.811156:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+14:11275:x1875636141489152:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 Request processed in 117us (7289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746306.811163:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 137 00010000:00010000:3.0:1788746307.069169:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746307.579068:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746307.579077:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746307.579955:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788746307.579968:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788746308.026649:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163517952:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.026725:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.026773:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163518464:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.026798:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.026848:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746308.026854:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163518080:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.026906:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.026960:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517952 00000100:00100000:2.0:1788746308.026967:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517952 00000100:00100000:2.0:1788746308.027002:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163518080 00000100:00100000:2.0:1788746308.027005:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163518080 00000100:00100000:2.0:1788746308.027042:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788746308.027050:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027097:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163517952:12345-0@lo:400:kworker.0 Request processed in 49us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027104:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788746308.027125:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788746308.027131:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027157:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163518080:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027171:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788746308.027191:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163518464 00000100:00100000:2.0:1788746308.027194:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163518464 00000100:00100000:2.0:1788746308.027220:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788746308.027226:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163518464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027272:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163518464:12345-0@lo:400:kworker.0 Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027278:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788746308.027298:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163518208:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027322:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.027343:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788746308.027349:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163517824:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027374:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.027395:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027442:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746308.027464:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163518336 00000100:00100000:2.0:1788746308.027468:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163518336 00000100:00100000:2.0:1788746308.027487:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788746308.027492:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163518336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027524:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875636163518336:12345-0@lo:400:kworker.0 Request processed in 31us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027529:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788746308.027562:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027589:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163518080:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027598:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163517952:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027618:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163518464:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027650:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163518208 00000100:00100000:2.0:1788746308.027654:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163518208 00000100:00100000:2.0:1788746308.027688:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788746308.027695:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163518208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027727:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163518208:12345-0@lo:400:kworker.0 Request processed in 34us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027733:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788746308.027761:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163518208:0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027790:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163517824 00000100:00100000:2.0:1788746308.027793:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163517824 00000100:00100000:2.0:1788746308.027815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788746308.027822:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163517824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746308.027854:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163517824:12345-0@lo:400:kworker.0 Request processed in 33us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746308.027860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1788746308.027888:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746308.027891:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746308.027894:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746308.027907:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163517824:0@lo:400:kworker.0 00010000:00010000:1.0:1788746308.094999:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746308.545747:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163518592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746308.545821:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746308.545896:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163518592 00000100:00100000:3.0:1788746308.545904:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163518592 00000100:00100000:3.0:1788746308.545943:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788746308.545952:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163518592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746308.545983:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746308.546025:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163518592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746308.546032:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788746308.546076:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163518592:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788746308.597108:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:0.0:1788746309.116745:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746309.716160:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746309.716238:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489280 00000100:00100000:1.0:1788746309.716247:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489280 00000100:00100000:1.0:1788746309.716318:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 138 00000100:00100000:1.0:1788746309.716329:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:11318:x1875636141489280:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746309.716346:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746309.716365:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3ec expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716446:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716469:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716481:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716497:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716504:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716511:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716747:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716755:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716761:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716767:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746309.716771:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716789:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716801:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:1.0:1788746309.716808:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.716814:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716820:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716833:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716840:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716846:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716849:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746309.716851:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716856:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716863:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cd4511ad200) 00010000:00010000:1.0:1788746309.716865:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.716868:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716872:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716901:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a299 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ec expref: 14 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716918:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:1.0:1788746309.716920:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.716924:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3ec expref: 14 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.716933:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401000, rc 0) 00000100:00100000:1.0:1788746309.716981:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:11318:x1875636141489280:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 655us (831us total) trans 0 rc 301/301 00000100:00100000:1.0:1788746309.716989:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 138 00000100:00080000:3.0:1788746309.717106:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746309.744504:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746309.744736:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489536 00000100:00100000:3.0:1788746309.744747:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489536 00000100:00100000:3.0:1788746309.744866:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 139 00000100:00100000:3.0:1788746309.744876:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+13:11318:x1875636141489536:12345-192.168.206.24@tcp:36:lfs.0 00010000:00010000:3.0:1788746309.744928:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746309.744953:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b309c25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b22c expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.744970:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:3.0:1788746309.744979:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746309.745180:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.745193:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.745203:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.745215:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.745222:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.745228:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746309.747008:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788746309.747022:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747041:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747048:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747055:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746309.747059:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747067:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747079:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746309.747082:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746309.747086:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.747093:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746309.747107:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000015199536 reply state 00000000db9274a7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746309.747115:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746309.747207:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+14:11318:x1875636141489536:12345-192.168.206.24@tcp:36:lfs.0 Request processed in 2330us (2709us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788746309.747215:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 139 00010000:00010000:1.0:1788746309.753512:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753530:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753539:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753545:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746309.753550:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753557:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753573:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cd44773eb00) 00010000:00010000:1.0:1788746309.753576:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.753581:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.753604:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a2b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746309.854331:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746309.858343:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489664 00000100:00100000:3.0:1788746309.858358:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489664 00000100:00100000:3.0:1788746309.858453:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 140 00000100:00100000:3.0:1788746309.858463:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+13:11326:x1875636141489664:12345-192.168.206.24@tcp:101:lctl.0 00010000:00010000:3.0:1788746309.858485:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746309.858505:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3f3 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858566:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858580:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858591:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746309.858622:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788746309.858626:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746309.858645:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858682:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a2bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3f3 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858698:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3f3 expref: 14 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746309.858706:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746309.858709:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746309.858713:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941e00, rc 0) 00000100:00100000:3.0:1788746309.858766:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+14:11326:x1875636141489664:12345-192.168.206.24@tcp:101:lctl.0 Request processed in 305us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746309.858780:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 140 00000100:00100000:3.0:1788746309.911865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746309.912081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141489792 00000100:00100000:2.0:1788746309.912090:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141489792 00000100:00100000:2.0:1788746309.912143:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 141 00000100:00100000:2.0:1788746309.912165:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:11332:x1875636141489792:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746309.912187:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746309.912209:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a2ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b3fa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912278:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912291:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912302:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912315:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912321:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912328:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912703:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912713:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912720:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746309.912755:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788746309.912759:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746309.912785:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912795:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912802:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912809:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912815:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746309.912819:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912826:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912837:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:2.0:1788746309.912840:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746309.912845:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912851:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912863:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912879:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912885:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912891:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746309.912894:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912900:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912908:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746309.912910:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746309.912912:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912918:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a2d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912943:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a2ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3fa expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912955:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3fa expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.912962:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746309.912965:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788746309.912971:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44e00, rc 0) 00000100:00100000:0.0:1788746309.913139:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+15:11332:x1875636141489792:12345-192.168.206.24@tcp:101:bash.0 Request processed in 974us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746309.913147:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 141 00000100:00100000:3.0:1788746309.915194:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746309.918395:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490048 00000100:00100000:1.0:1788746309.918425:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490048 00000100:00100000:1.0:1788746309.918496:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 142 00000100:00100000:1.0:1788746309.918506:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+15:11332:x1875636141490048:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:1.0:1788746309.918525:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746309.918545:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b401 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918667:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918682:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918694:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918709:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918714:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.918720:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746309.919229:0:8618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788746309.919382:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919393:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919424:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919457:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919464:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919471:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919477:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746309.919480:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919488:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919497:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746309.919500:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.919504:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919511:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a2ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746309.919536:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009d5361d2 reply state 000000007fb79402 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746309.919544:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788746309.919569:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a2e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 18 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919584:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 17 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.919592:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:1.0:1788746309.919594:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746309.919597:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401800, rc 0) 00000100:00100000:1.0:1788746309.919673:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11332:x1875636141490048:12345-192.168.206.24@tcp:101:bash.0 Request processed in 1167us (4484us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788746309.919682:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 142 00010000:00010000:1.0:1788746309.928503:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928520:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928529:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928536:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746309.928541:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928566:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928581:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511ad200) 00010000:00010000:1.0:1788746309.928584:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746309.928589:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.928596:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a2f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746309.932388:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746309.932568:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490176 00000100:00100000:2.0:1788746309.932577:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490176 00000100:00100000:2.0:1788746309.932643:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:2.0:1788746309.932669:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2350:x1875636141490176:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746309.932686:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746309.932706:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b408 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746309.932730:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746309.932747:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788746309.932752:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746309.932761:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.932778:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.932790:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45600, rc 0) 00000100:00100000:2.0:1788746309.932841:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141490176:12345-192.168.206.24@tcp:101:bash.0 Request processed in 190us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746309.932847:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00080000:3.0:1788746309.933176:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746309.937088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746309.937309:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490304 00000100:00100000:2.0:1788746309.937318:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490304 00000100:00100000:2.0:1788746309.937381:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:2.0:1788746309.937391:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:11332:x1875636141490304:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746309.937440:0:8456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746309.937471:0:8456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b40f expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.937502:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.937510:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746309.937514:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746309.937519:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.937548:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746309.937567:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746309.937579:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8456:1875636163518720:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746309.937665:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eaa8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788746309.942667:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8456:1875636163518720:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746309.942705:0:8456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 7 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746309.942726:0:8456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44600, rc 0) 00000100:00100000:0.0:1788746309.942790:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:11332:x1875636141490304:12345-192.168.206.24@tcp:101:bash.0 Request processed in 5399us (5709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746309.942799:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:3.0:1788746309.944962:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746309.945053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490432 00000100:00100000:1.0:1788746309.945062:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490432 00010000:00010000:1.0:1788746309.945099:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746309.945138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:1.0:1788746309.945147:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141490432:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746309.945161:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746309.945182:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.945196:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.945229:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbc4c303/0xe59b64da5b30a309 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b408 expref: 7 pid: 6682 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.945263:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746309.945267:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746309.945274:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.945283:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746309.945318:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746309.945342:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1875636163518848:192.168.206.24@tcp:105: 00000100:00100000:1.0:1788746309.945447:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746309.952462:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1875636163518848:192.168.206.24@tcp:105: 00000100:00100000:0.0:1788746309.952463:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:1.0:1788746309.952491:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746309.952548:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141490432:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 7402us (7591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746309.952559:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:3.0:1788746309.952648:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490688 00000100:00100000:3.0:1788746309.952665:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490688 00000100:00100000:3.0:1788746309.952715:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:3.0:1788746309.952725:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+17:11332:x1875636141490688:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:3.0:1788746309.952983:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11332:x1875636141490688:12345-192.168.206.24@tcp:35:bash.0 Request processed in 258us (523us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788746309.952989:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:0.0:1788746310.031483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.031582:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141490944 00000100:00100000:3.0:1788746310.031592:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141490944 00000100:00100000:3.0:1788746310.031667:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 143 00000100:00100000:3.0:1788746310.031678:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11342:x1875636141490944:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746310.031703:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746310.031725:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b416 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746310.031809:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788746310.031911:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a317 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b416 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.031940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746310.031943:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746310.031948:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b416 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.031961:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746310.032015:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11342:x1875636141490944:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 339us (542us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788746310.032023:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 143 00000100:00100000:2.0:1788746310.037978:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.038087:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141491200 00000100:00100000:3.0:1788746310.038096:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141491200 00000100:00100000:3.0:1788746310.038140:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:3.0:1788746310.038150:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11342:x1875636141491200:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746310.038353:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11342:x1875636141491200:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 204us (383us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788746310.038361:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:0.0:1788746310.126539:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.127870:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141491328 00000100:00100000:1.0:1788746310.127880:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141491328 00000100:00100000:1.0:1788746310.127941:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 144 00000100:00100000:1.0:1788746310.127952:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11348:x1875636141491328:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746310.127975:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746310.127995:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b41d expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128084:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128098:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128111:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746310.128144:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788746310.128148:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746310.128165:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128188:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b41d expref: 22 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128210:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b41d expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.128218:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746310.128221:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746310.128224:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400800, rc 0) 00000100:00100000:1.0:1788746310.128500:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+21:11348:x1875636141491328:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 548us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746310.128508:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 144 00000100:00100000:0.0:1788746310.134640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.135324:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141491584 00000100:00100000:3.0:1788746310.135391:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141491584 00000100:00100000:3.0:1788746310.135518:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 145 00000100:00100000:3.0:1788746310.135528:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+21:11348:x1875636141491584:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746310.135546:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746310.135563:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.135645:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a33a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.135676:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a33a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.135688:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a33a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746310.135708:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788746310.135821:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b424 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.135836:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a33a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b424 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.135844:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:3.0:1788746310.135847:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746310.135851:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941c00, rc 0) 00000100:00100000:3.0:1788746310.136188:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11348:x1875636141491584:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 661us (1555us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788746310.136196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 145 00000100:00100000:2.0:1788746310.142127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.142161:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141491840 00000100:00100000:2.0:1788746310.142169:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141491840 00000100:00100000:2.0:1788746310.142230:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 146 00000100:00100000:2.0:1788746310.142241:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11348:x1875636141491840:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746310.142262:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746310.142288:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b42b expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.142367:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.142380:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.142389:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746310.142417:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788746310.142516:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b42b expref: 26 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.142532:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b42b expref: 25 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.142540:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:2.0:1788746310.142544:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788746310.142547:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44c00, rc 0) 00000100:00100000:2.0:1788746310.142590:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+25:11348:x1875636141491840:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 352us (471us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788746310.142596:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 146 00000100:00100000:0.0:1788746310.144666:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.144853:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141491968 00000100:00100000:2.0:1788746310.144861:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141491968 00000100:00100000:2.0:1788746310.144916:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:2.0:1788746310.144925:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+25:2349:x1875636141491968:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746310.144950:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746310.144969:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a33a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b424 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.144986:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:2.0:1788746310.144990:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746310.145030:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+24:2349:x1875636141491968:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 106us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.145037:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00010000:00010000:1.0:1788746310.148004:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746310.148571:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.148665:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492096 00000100:00100000:2.0:1788746310.148675:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492096 00000100:00100000:2.0:1788746310.148722:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:2.0:1788746310.148732:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141492096:12345-192.168.206.24@tcp:1:lfs.0 00010000:00010000:2.0:1788746310.148777:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.148797:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.148806:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746310.148810:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746310.148815:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.148853:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.148886:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 6 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.148901:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875636163518976:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746310.148978:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eaa8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746310.152888:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1875636163518976:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746310.152921:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746310.154691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.154809:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492224 00000100:00100000:3.0:1788746310.154820:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492224 00002000:00100000:3.0:1788746310.154866:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cd45f784380 x1875636141492224/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:321/0 lens 504/0 e 0 to 0 dl 1788746321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746310.154876:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f784380 with x1875636141492224 ext(0->12) 00010000:00010000:3.0:1788746310.154971:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 7 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.155006:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 7 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746310.155013:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd45f784380 00000100:00100000:3.0:1788746310.155045:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:3.0:1788746310.155054:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141492224:12345-192.168.206.24@tcp:4:lfs.0 00000100:00100000:3.0:1788746310.155741:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141492224:12345-192.168.206.24@tcp:4:lfs.0 Request processed in 686us (1055us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788746310.155749:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00002000:00100000:3.0:1788746310.155757:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cd45f784380 x1875636141492224/t4294967305(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:321/0 lens 504/448 e 0 to 0 dl 1788746321 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746310.155766:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f784380 with x1875636141492224 ext(0->12) 00010000:00010000:3.0:1788746310.155772:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.155784:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746310.155792:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd45f784380 00000100:00100000:0.0:1788746310.159192:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.159321:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492352 00000100:00100000:3.0:1788746310.159330:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492352 00010000:00010000:3.0:1788746310.159363:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746310.159452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:3.0:1788746310.159578:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2347:x1875636141492352:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746310.160473:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788746310.160494:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788746310.160499:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788746310 00002000:00010000:2.0:1788746310.160501:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788746310 00002000:00010000:2.0:1788746310.160503:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788746310 00010000:00010000:2.0:1788746310.160512:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.160526:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.160548:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c45cee/0xe59b64da5b30a310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b40f expref: 9 pid: 8456 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.160565:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746310.160578:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746310.160584:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.160593:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.160629:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746310.160717:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.160728:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.160763:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.160995:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.161005:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.161012:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746310.161015:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.161025:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.161038:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.161047:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a35d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.161081:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2347:x1875636141492352:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 1619us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.161094:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:0.0:1788746310.161094:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2348:x1875636141492096:12345-192.168.206.24@tcp:1:lfs.0 Request processed in 12361us (12528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746310.161106:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:0.0:1788746310.166435:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746310.166698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746310.166730:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746310.166752:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746310.166790:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492864 00000100:00100000:0.0:1788746310.166799:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492864 00000100:00100000:0.0:1788746310.166865:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:0.0:1788746310.166875:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141492864:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746310.166934:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141492864:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746310.166942:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 90 00000100:00100000:2.0:1788746310.166957:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492992 00000100:00100000:2.0:1788746310.166963:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492992 00000100:00080000:0.0:1788746310.166965:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746310.167009:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 151 00000100:00100000:2.0:1788746310.167017:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141492992:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:0.0:1788746310.167042:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746310.167052:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141492992:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 36us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.167060:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 151 00000100:00100000:1.0:1788746310.167271:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492736 00000100:00100000:1.0:1788746310.167287:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492736 00000100:00100000:1.0:1788746310.167316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 295 00000100:00100000:1.0:1788746310.167322:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141492736:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746310.167351:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141492736:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746310.167358:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 295 00000100:00100000:3.0:1788746310.171608:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141492608 00000100:00100000:3.0:1788746310.171621:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141492608 00000100:00100000:2.0:1788746310.171951:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:2.0:1788746310.171962:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450cef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+24:11348:x1875636141492608:12345-192.168.206.24@tcp:35:lfs.0 00000004:00010000:2.0:1788746310.172016:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b42b expref: 24 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746310.172502:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788746310.172616:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788746310.173970:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1788746310.174027:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.174051:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 28 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.174061:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.174092:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 28 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.174108:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 28 pid: 8618 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.174121:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1875636163519104:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746310.174200:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746310.177140:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.177236:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141493120 00000100:00100000:1.0:1788746310.177246:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141493120 00010000:00010000:1.0:1788746310.177276:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 29 pid: 8618 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746310.177313:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:1.0:1788746310.177321:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+29:2350:x1875636141493120:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746310.177334:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746310.177340:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 29 pid: 8618 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.177352:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 29 pid: 8618 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.177371:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:1.0:1788746310.177377:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.177386:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.177393:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.177455:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746310.177493:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+29:2350:x1875636141493120:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746310.177501:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 61 00010000:00010000:2.0:1788746310.177593:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b401 expref: 28 pid: 8618 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.177615:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1875636163519104:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746310.177633:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.177791:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.177800:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746310.177969:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788746310.178154:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788746310.178254:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163519232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788746310.178295:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746310.178894:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163519232 00000100:00100000:3.0:1788746310.178901:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163519232 00000100:00100000:2.0:1788746310.178904:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eaa8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788746310.178990:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746310.178998:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875636163519232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788746310.179073:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875636163519232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746310.179080:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746310.179176:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163519232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788746310.179872:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788746310.179931:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163519360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788746310.179962:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746310.179987:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746310.180090:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163519360 00000100:00100000:3.0:1788746310.180096:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163519360 00000100:00100000:3.0:1788746310.180164:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746310.180171:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875636163519360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788746310.180319:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875636163519360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (351us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788746310.180326:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746310.180370:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1875636163519360:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788746310.180383:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788746310.180438:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788746310.180471:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180481:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180489:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180494:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746310.180498:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180506:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180519:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:2.0:1788746310.180522:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788746310.180534:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.180540:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a364 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788746310.180999:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788746310.181090:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788746310.181101:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384585701383ns, next at 385585699375ns, rc = 0 00000001:00080000:2.0:1788746310.181107:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788746310.181138:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511add00) 00010000:00010000:2.0:1788746310.181142:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788746310.181149:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a34f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b42b expref: 32 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.181433:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450cef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11348:x1875636141492608:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 9472us (16208us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788746310.181443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00000020:00080000:2.0:1788746310.181447:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788746310.184168:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.184279:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141493248 00000100:00100000:2.0:1788746310.184293:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141493248 00000100:00100000:2.0:1788746310.184640:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 147 00000100:00100000:2.0:1788746310.184787:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11348:x1875636141493248:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746310.184808:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746310.184989:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a36b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b432 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.185050:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a36b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b432 expref: 32 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.185085:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a36b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b432 expref: 32 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.185106:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746310.185109:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746310.185113:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45000, rc 0) 00000100:00100000:2.0:1788746310.185543:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11348:x1875636141493248:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 759us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.185551:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 147 00000100:00100000:0.0:1788746310.210070:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.210159:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141493504 00000100:00100000:1.0:1788746310.210169:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141493504 00000100:00100000:1.0:1788746310.210222:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:1.0:1788746310.210232:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11348:x1875636141493504:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:1.0:1788746310.210457:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+33:11348:x1875636141493504:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 226us (393us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788746310.210465:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:0.0:1788746310.257164:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.257372:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141493760 00000100:00100000:2.0:1788746310.257381:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141493760 00000100:00100000:3.0:1788746310.257675:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 148 00000100:00100000:3.0:1788746310.257686:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+33:11358:x1875636141493760:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746310.257709:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746310.257727:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746310.257835:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788746310.257945:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a372 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b439 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.257958:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746310.257961:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746310.257967:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b439 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.257980:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746310.258031:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11358:x1875636141493760:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 348us (877us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1788746310.258038:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 148 00000100:00100000:2.0:1788746310.263159:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746310.263515:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141493888 00000100:00100000:0.0:1788746310.263525:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141493888 00000100:00100000:0.0:1788746310.264118:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 149 00000100:00100000:0.0:1788746310.264130:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11358:x1875636141493888:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:0.0:1788746310.264201:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264217:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264228:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264257:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264265:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264272:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264374:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264383:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264390:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746310.264457:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.264469:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265090:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265102:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265108:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746310.265112:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265128:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265142:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746310.265145:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746310.265150:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265157:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265172:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265178:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265185:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265190:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746310.265193:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265199:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265207:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412500) 00010000:00010000:0.0:1788746310.265210:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746310.265213:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265229:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265246:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265251:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265257:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265262:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746310.265265:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265271:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265279:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746310.265282:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746310.265285:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746310.265290:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a38e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746310.265794:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11358:x1875636141493888:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 1664us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746310.265804:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 149 00000100:00100000:0.0:1788746310.268314:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.268515:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141494144 00000100:00100000:1.0:1788746310.268524:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141494144 00000100:00100000:1.0:1788746310.268573:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:1.0:1788746310.268584:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11358:x1875636141494144:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:1.0:1788746310.268804:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:11358:x1875636141494144:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 221us (494us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788746310.268812:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:1.0:1788746310.305219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.305290:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141494400 00000100:00100000:2.0:1788746310.305301:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141494400 00000100:00100000:2.0:1788746310.305513:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 150 00000100:00100000:2.0:1788746310.305529:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:11361:x1875636141494400:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746310.305554:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746310.305575:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305827:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305852:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305871:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305898:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305905:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.305913:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306031:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306041:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306048:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746310.306058:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788746310.306144:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306152:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306160:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306166:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746310.306170:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306186:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306197:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746310.306200:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746310.306205:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306212:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a39c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306224:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306229:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306235:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306240:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746310.306242:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306249:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306255:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd46e1acb00) 00010000:00010000:2.0:1788746310.306258:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746310.306261:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306277:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306319:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306333:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.306341:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746310.306344:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746310.306346:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:2.0:1788746310.307139:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11361:x1875636141494400:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 1611us (1923us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788746310.307148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 150 00000100:00100000:2.0:1788746310.311234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.315139:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141494528 00000100:00100000:1.0:1788746310.315154:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141494528 00000100:00100000:1.0:1788746310.315347:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 151 00000100:00100000:1.0:1788746310.315358:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11361:x1875636141494528:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746310.315440:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315473:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315485:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315512:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315519:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315526:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315532:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746310.315537:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315544:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315555:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746310.315558:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746310.315562:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.315569:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746310.315650:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11361:x1875636141494528:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 293us (4423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746310.315673:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 151 00000100:00100000:0.0:1788746310.319497:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.319532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141494784 00000100:00100000:2.0:1788746310.319541:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141494784 00000100:00100000:2.0:1788746310.319586:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:2.0:1788746310.319596:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11361:x1875636141494784:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:2.0:1788746310.320026:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+38:11361:x1875636141494784:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 430us (537us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788746310.320033:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:0.0:1788746310.533462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.533546:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141495040 00000100:00100000:3.0:1788746310.533555:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141495040 00000100:00100000:3.0:1788746310.533617:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 152 00000100:00100000:3.0:1788746310.533626:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+38:11392:x1875636141495040:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:3.0:1788746310.533795:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746310.533815:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a3bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b447 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.533904:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a3c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.533918:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.533943:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746310.533955:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788746310.534067:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a3bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b447 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.534086:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b447 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.534095:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746310.534098:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746310.534102:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746310.534158:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11392:x1875636141495040:12345-192.168.206.24@tcp:101:cat.0 Request processed in 533us (704us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788746310.534166:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 152 00000100:00100000:0.0:1788746310.537214:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.537617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141495168 00000100:00100000:1.0:1788746310.537628:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141495168 00000100:00100000:1.0:1788746310.537759:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:1.0:1788746310.537770:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+40:2350:x1875636141495168:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746310.537787:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788746310.537800:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:1.0:1788746310.537812:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a3c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b447 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.537833:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746310.537838:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746310.537900:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+39:2350:x1875636141495168:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 132us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746310.537904:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141495424 00000100:00100000:1.0:1788746310.537910:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:3.0:1788746310.537911:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141495424 00000100:00100000:3.0:1788746310.538583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:3.0:1788746310.538593:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+39:11392:x1875636141495424:12345-192.168.206.24@tcp:35:cat.0 00000100:00100000:3.0:1788746310.539083:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11392:x1875636141495424:12345-192.168.206.24@tcp:35:cat.0 Request processed in 490us (1284us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788746310.539093:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:0.0:1788746310.582786:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.583073:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141495680 00000100:00100000:2.0:1788746310.583095:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141495680 00000100:00100000:2.0:1788746310.583159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 153 00000100:00100000:2.0:1788746310.583184:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11398:x1875636141495680:12345-192.168.206.24@tcp:101:dd.0 00010000:00010000:2.0:1788746310.583204:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746310.583207:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788746310.583231:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a32c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b41d expref: 40 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583253:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746310.583259:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746310.583284:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a3d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b44e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583369:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583383:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583392:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583472:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.583496:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 40 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.583510:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163519488:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746310.583610:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446bbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746310.586912:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.587058:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141495808 00000100:00100000:3.0:1788746310.587068:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141495808 00010000:00010000:3.0:1788746310.587115:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 41 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746310.587172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00100000:3.0:1788746310.587181:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+41:2349:x1875636141495808:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746310.587195:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746310.587201:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 41 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.587212:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 41 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.587232:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746310.587237:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.587246:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.587254:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.587271:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746310.587319:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+41:2349:x1875636141495808:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 138us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746310.587326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 62 00010000:00010000:2.0:1788746310.587713:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a3aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b440 expref: 40 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.587730:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163519488:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746310.587749:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.587758:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.587765:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746310.587784:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788746310.587992:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a3d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.588010:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.588018:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746310.588020:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746310.588023:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45c00, rc 0) 00000100:00100000:2.0:1788746310.588063:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11398:x1875636141495680:12345-192.168.206.24@tcp:101:dd.0 Request processed in 4881us (5298us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788746310.588070:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 153 00000100:00100000:0.0:1788746310.593025:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.593160:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496064 00000100:00100000:2.0:1788746310.593170:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496064 00000100:00100000:2.0:1788746310.593263:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 154 00000100:00100000:2.0:1788746310.593293:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11398:x1875636141496064:12345-192.168.206.24@tcp:36:dd.0 00010000:00010000:2.0:1788746310.593569:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.593584:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.593596:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746310.593645:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1788746310.593683:0:5849:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b18f29b8 reply state 00000000ae66a2f6 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.593692:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746310.593769:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+43:11398:x1875636141496064:12345-192.168.206.24@tcp:36:dd.0 Request processed in 477us (750us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788746310.593776:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 154 00000020:00080000:2.0:1788746310.593781:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746310.595686:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595700:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595708:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595714:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746310.595718:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595727:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595753:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746310.595755:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746310.595761:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.595766:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a3e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746310.651307:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788746310.651317:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788746310.652395:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788746310.652628:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746310.775037:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.775390:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496192 00000100:00100000:1.0:1788746310.775424:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496192 00000100:00100000:1.0:1788746310.775487:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 155 00000100:00100000:1.0:1788746310.775498:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+42:11412:x1875636141496192:12345-192.168.206.24@tcp:101:stat.0 00010000:00010000:1.0:1788746310.775521:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746310.775542:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b455 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775603:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775617:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775639:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775662:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775683:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.775690:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.776076:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.776087:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.776096:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.776129:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.776144:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 43 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746310.776158:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163519616:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746310.776421:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788746310.781081:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746310.781193:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163519616:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746310.781222:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.781329:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496448 00000100:00100000:2.0:1788746310.781336:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496448 00000100:00100000:2.0:1788746310.781385:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:2.0:1788746310.781394:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+44:5588:x1875636141496448:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788746310.781783:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+45:5588:x1875636141496448:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 389us (709us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788746310.781791:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:0.0:1788746310.784532:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.784618:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496576 00000100:00100000:2.0:1788746310.784627:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496576 00010000:00010000:2.0:1788746310.784845:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 45 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746310.784956:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:2.0:1788746310.784966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd444ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+45:2350:x1875636141496576:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746310.784980:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746310.784987:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 45 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785000:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 45 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785022:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a3db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b44e expref: 45 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785038:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746310.785043:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785052:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785060:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.785096:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746310.785148:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd444ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+44:2350:x1875636141496576:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 183us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.785155:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 63 00010000:00010000:3.0:1788746310.785368:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785376:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746310.785444:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788746310.785449:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746310.785469:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785481:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785489:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785495:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785501:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785506:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746310.785510:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785517:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785526:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:3.0:1788746310.785529:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746310.785532:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785539:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a3f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785564:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785571:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785577:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785582:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746310.785585:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785591:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785599:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511ad200) 00010000:00010000:3.0:1788746310.785601:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746310.785605:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785610:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785664:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b455 expref: 44 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785679:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b455 expref: 43 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.785708:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746310.785710:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746310.785713:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400800, rc 0) 00000100:00100000:3.0:1788746310.785751:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+43:11412:x1875636141496192:12345-192.168.206.24@tcp:101:stat.0 Request processed in 10256us (10722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746310.785759:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 155 00000100:00100000:0.0:1788746310.847602:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746310.847744:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496832 00000100:00100000:3.0:1788746310.847753:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496832 00000100:00100000:3.0:1788746310.847818:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 156 00000100:00100000:3.0:1788746310.847828:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+43:11418:x1875636141496832:12345-192.168.206.24@tcp:36:truncate.0 00010000:00010000:3.0:1788746310.847882:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746310.847906:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400800/0xe59b64da5b30a405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b455 expref: 43 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.847927:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746310.847932:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746310.848112:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.848126:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746310.848135:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746310.848182:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1788746310.848203:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003117f2e4 reply state 0000000043648720 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746310.848224:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746310.848324:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+45:11418:x1875636141496832:12345-192.168.206.24@tcp:36:truncate.0 Request processed in 496us (728us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788746310.848331:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 156 00000020:00080000:3.0:1788746310.848335:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746310.850534:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850559:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850567:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850574:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746310.850579:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850587:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850600:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746310.850602:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746310.850607:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746310.850613:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a40c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746310.970344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746310.970664:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141496960 00000100:00100000:2.0:1788746310.970687:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141496960 00000100:00100000:2.0:1788746310.970754:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 157 00000100:00100000:2.0:1788746310.970778:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+44:11432:x1875636141496960:12345-192.168.206.24@tcp:101:stat.0 00010000:00010000:2.0:1788746310.970803:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746310.970824:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b45c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970893:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970906:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970917:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970932:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970939:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.970946:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971037:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971045:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971053:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746310.971099:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788746310.971104:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746310.971122:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971136:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971145:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971152:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971157:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971163:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746310.971167:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971174:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971186:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746310.971190:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746310.971194:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971201:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a41a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971238:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971244:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971250:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971255:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746310.971259:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971265:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971272:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd46e1acb00) 00010000:00010000:2.0:1788746310.971275:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746310.971278:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971283:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971312:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971326:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746310.971345:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746310.971347:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746310.971349:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:2.0:1788746310.971474:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+45:11432:x1875636141496960:12345-192.168.206.24@tcp:101:stat.0 Request processed in 709us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746310.971482:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 157 00000100:00100000:0.0:1788746311.054196:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.054331:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141497216 00000100:00100000:3.0:1788746311.054341:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141497216 00000100:00100000:3.0:1788746311.054424:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 158 00000100:00100000:3.0:1788746311.054434:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+45:11442:x1875636141497216:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746311.054451:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.054469:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a42f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b463 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746311.054547:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788746311.054673:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a42f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b463 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.054686:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746311.054697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746311.054702:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a42f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b463 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.054716:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746311.054778:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+46:11442:x1875636141497216:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 346us (590us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788746311.054785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 158 00000100:00080000:0.0:1788746311.055572:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746311.057938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.058052:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141497472 00000100:00100000:3.0:1788746311.058073:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141497472 00000100:00100000:3.0:1788746311.058127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:3.0:1788746311.058137:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450cef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+46:11442:x1875636141497472:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746311.058353:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450cef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+47:11442:x1875636141497472:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 216us (436us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788746311.058361:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:3.0:1788746311.102211:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746311.102234:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163519744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746311.102302:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746311.102425:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163519744 00000100:00100000:2.0:1788746311.102433:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163519744 00000100:00100000:2.0:1788746311.102478:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788746311.102487:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875636163519744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746311.102507:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746311.102549:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875636163519744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746311.102556:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788746311.102967:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163519744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746311.130956:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.131051:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141497728 00000100:00100000:2.0:1788746311.131062:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141497728 00000100:00100000:2.0:1788746311.131117:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 159 00000100:00100000:2.0:1788746311.131129:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+47:11448:x1875636141497728:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746311.131156:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746311.131175:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a43d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b46a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.131287:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.131301:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.131322:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.131358:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.131371:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 48 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746311.131385:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163519872:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746311.131513:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446bba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746311.134500:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163519872:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746311.134538:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746311.136660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.136949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141497856 00000100:00100000:3.0:1788746311.136958:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141497856 00010000:00010000:3.0:1788746311.136993:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 49 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746311.137032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:3.0:1788746311.137042:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+49:2349:x1875636141497856:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746311.137057:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746311.137064:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 49 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137076:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 49 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137097:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b45c expref: 49 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137130:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746311.137135:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137146:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137154:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.137184:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746311.137260:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:2349:x1875636141497856:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 219us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.137268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 64 00010000:00010000:2.0:1788746311.137995:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.138006:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746311.138028:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788746311.138197:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a43d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.138216:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.138253:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746311.138256:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746311.138258:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44400, rc 0) 00000100:00100000:2.0:1788746311.138561:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:11448:x1875636141497728:12345-192.168.206.24@tcp:101:bash.0 Request processed in 7434us (7613us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788746311.138570:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 159 00000100:00100000:1.0:1788746311.153567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.153659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141498112 00000100:00100000:3.0:1788746311.153670:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141498112 00000100:00100000:3.0:1788746311.153729:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 160 00000100:00100000:3.0:1788746311.153740:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+48:11448:x1875636141498112:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:3.0:1788746311.154012:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.154029:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.154041:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746311.154089:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1788746311.154113:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d349ce31 reply state 000000007e5189f8 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746311.154134:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746311.154235:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+51:11448:x1875636141498112:12345-192.168.206.24@tcp:36:bash.0 Request processed in 495us (675us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788746311.154242:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 160 00000020:00080000:3.0:1788746311.154246:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746311.155892:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155906:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155928:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155934:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746311.155939:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155948:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155962:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746311.155966:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746311.155970:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.155976:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a452 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.162753:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746311.163635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.163838:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141498240 00000100:00100000:3.0:1788746311.163848:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141498240 00000100:00100000:3.0:1788746311.163905:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 161 00000100:00100000:3.0:1788746311.163915:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+50:11448:x1875636141498240:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746311.163936:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.163954:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b471 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.164045:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.164058:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.164066:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.164097:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.164111:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 51 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746311.164137:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163520000:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746311.164211:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788746311.167099:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.167201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141498368 00000100:00100000:0.0:1788746311.167210:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141498368 00010000:00010000:0.0:1788746311.167245:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 52 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746311.167284:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:0.0:1788746311.167294:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:2350:x1875636141498368:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746311.167308:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746311.167315:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 52 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.167326:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 52 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.167362:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746311.167367:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.167376:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.167384:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.167434:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746311.167479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:2350:x1875636141498368:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.167486:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 65 00010000:00010000:1.0:1788746311.167582:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a444 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b46a expref: 51 pid: 5850 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746311.167598:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163520000:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746311.167617:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.167639:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.167645:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746311.167700:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788746311.167704:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746311.167722:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.167748:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b471 expref: 51 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.167763:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b471 expref: 50 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.167771:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746311.167774:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746311.167776:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:1.0:1788746311.167802:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+50:11448:x1875636141498240:12345-192.168.206.24@tcp:101:bash.0 Request processed in 3889us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746311.167809:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 161 00000100:00100000:1.0:1788746311.171325:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.171525:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141498624 00000100:00100000:3.0:1788746311.171534:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141498624 00000100:00100000:3.0:1788746311.171588:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:3.0:1788746311.171598:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:11448:x1875636141498624:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:3.0:1788746311.171845:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:11448:x1875636141498624:12345-192.168.206.24@tcp:35:bash.0 Request processed in 247us (527us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788746311.171852:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:3.0:1788746311.271484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.271617:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141498880 00000100:00100000:0.0:1788746311.271636:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141498880 00000100:00100000:0.0:1788746311.271698:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 162 00000100:00100000:0.0:1788746311.271709:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+51:11458:x1875636141498880:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746311.271732:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746311.271753:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b478 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746311.271844:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788746311.271954:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a467 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b478 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.271967:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:0.0:1788746311.271982:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746311.271988:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b478 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.272003:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9e00, rc 0) 00000100:00100000:0.0:1788746311.272066:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11458:x1875636141498880:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 358us (590us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1788746311.272074:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 162 00000100:00100000:0.0:1788746311.275513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.275594:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141499008 00000100:00100000:2.0:1788746311.275603:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141499008 00000100:00100000:2.0:1788746311.275669:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 163 00000100:00100000:2.0:1788746311.275679:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11458:x1875636141499008:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:2.0:1788746311.275741:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275756:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275767:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275779:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275786:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275792:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275883:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275892:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275900:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746311.275936:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275948:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275955:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275962:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275968:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746311.275972:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275980:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.275990:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746311.275993:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746311.275997:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276010:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276024:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276030:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276036:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276041:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746311.276045:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276051:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276059:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd46e1acb00) 00010000:00010000:2.0:1788746311.276062:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746311.276064:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276070:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44600/0xe59b64da5b30a47c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276083:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276088:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276100:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276104:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746311.276107:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276112:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276120:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746311.276123:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746311.276125:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.276130:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746311.276198:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11458:x1875636141499008:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 520us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746311.276206:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 163 00000100:00100000:1.0:1788746311.279618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.279739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141499264 00000100:00100000:3.0:1788746311.279748:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141499264 00000100:00100000:3.0:1788746311.279813:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:3.0:1788746311.279823:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11458:x1875636141499264:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746311.280037:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+53:11458:x1875636141499264:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 215us (425us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788746311.280045:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:3.0:1788746311.346010:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.346110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141499520 00000100:00100000:0.0:1788746311.346119:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141499520 00000100:00100000:0.0:1788746311.346191:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 164 00000100:00100000:0.0:1788746311.346201:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+53:11461:x1875636141499520:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746311.346224:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746311.346254:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a48a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b47f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346344:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346356:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346366:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346378:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346384:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346436:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346574:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a49f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346584:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346592:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746311.346602:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788746311.346717:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346725:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346731:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346737:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.346741:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346748:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346759:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746311.346762:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.346774:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346780:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346794:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346801:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346807:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346812:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.346814:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346820:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346827:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412500) 00010000:00010000:0.0:1788746311.346830:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.346832:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346838:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346879:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a48a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b47f expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346904:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b47f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.346911:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746311.346914:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788746311.346916:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9e00, rc 0) 00000100:00100000:0.0:1788746311.346991:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11461:x1875636141499520:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 792us (989us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788746311.346999:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 164 00000100:00100000:0.0:1788746311.351022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.351124:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141499648 00000100:00100000:2.0:1788746311.351136:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141499648 00000100:00100000:2.0:1788746311.351199:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 165 00000100:00100000:2.0:1788746311.351210:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11461:x1875636141499648:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:2.0:1788746311.351286:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351302:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351326:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351351:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351358:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351364:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351370:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746311.351373:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351380:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351390:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746311.351393:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746311.351640:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.351659:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44400/0xe59b64da5b30a4ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746311.351780:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11461:x1875636141499648:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 572us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746311.351788:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 165 00000100:00100000:3.0:1788746311.354473:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.354568:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141499904 00000100:00100000:0.0:1788746311.354576:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141499904 00000100:00100000:0.0:1788746311.354633:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:0.0:1788746311.354644:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11461:x1875636141499904:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746311.354878:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11461:x1875636141499904:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 235us (411us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788746311.354886:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:1.0:1788746311.358104:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.359594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141500032 00000100:00100000:3.0:1788746311.359606:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141500032 00000100:00100000:3.0:1788746311.359698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:3.0:1788746311.359710:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+56:2348:x1875636141500032:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746311.359738:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746311.359772:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a49f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b47f expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.359792:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746311.359797:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746311.359861:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+55:2348:x1875636141500032:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 155us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.359868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:3.0:1788746311.532189:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.532441:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141500288 00000100:00100000:0.0:1788746311.532450:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141500288 00000100:00100000:0.0:1788746311.532506:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 166 00000100:00100000:0.0:1788746311.532517:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11479:x1875636141500288:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:0.0:1788746311.532539:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746311.532559:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b486 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.532687:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a4bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.532701:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a4bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.532712:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a4bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746311.532724:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788746311.532978:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b486 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.532996:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a4bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b486 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.533004:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746311.533007:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788746311.533011:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9c00, rc 0) 00000100:00100000:0.0:1788746311.533661:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11479:x1875636141500288:12345-192.168.206.24@tcp:101:cat.0 Request processed in 554us (889us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788746311.533672:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 166 00000100:00100000:0.0:1788746311.610149:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746311.610265:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141500416 00000100:00100000:1.0:1788746311.610275:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141500416 00000100:00100000:1.0:1788746311.610336:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 167 00000100:00100000:1.0:1788746311.610347:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11480:x1875636141500416:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746311.610370:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746311.610389:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a4c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b48d expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610509:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610523:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610536:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746311.610570:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788746311.610573:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746311.610588:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610612:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a4c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b48d expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610655:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b48d expref: 58 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.610663:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746311.610666:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746311.610669:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400c00, rc 0) 00000100:00100000:1.0:1788746311.610718:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11480:x1875636141500416:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 373us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746311.610724:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 167 00000100:00100000:1.0:1788746311.618875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.618977:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141500800 00000100:00100000:0.0:1788746311.618987:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141500800 00000100:00100000:0.0:1788746311.619043:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:0.0:1788746311.619054:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11480:x1875636141500800:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746311.619436:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11480:x1875636141500800:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 382us (569us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788746311.619445:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:3.0:1788746311.632071:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.632162:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141500928 00000100:00100000:0.0:1788746311.632173:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141500928 00000100:00100000:0.0:1788746311.632259:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:0.0:1788746311.632270:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11480:x1875636141500928:12345-192.168.206.24@tcp:103:lfs.0 00010000:00010000:0.0:1788746311.632287:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788746311.632311:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b471 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.632336:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a4bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b486 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.632350:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30a36b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b432 expref: 57 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.632359:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746311.632369:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746311.632473:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11480:x1875636141500928:12345-192.168.206.24@tcp:103:lfs.0 Request processed in 204us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.632480:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:1.0:1788746311.635810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.635890:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501056 00000100:00100000:0.0:1788746311.635900:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501056 00000100:00100000:0.0:1788746311.635955:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 168 00000100:00100000:0.0:1788746311.635965:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11480:x1875636141501056:12345-192.168.206.24@tcp:58:lfs.0 00010000:00010000:0.0:1788746311.636086:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.636102:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.636114:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746311.636478:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788746311.636600:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11480:x1875636141501056:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 635us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.636608:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 168 00000040:00080000:1.0:1788746311.674947:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788746311.674955:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788746311.675005:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788746311.675011:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788746311.675134:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163520128:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788746311.675456:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44609e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746311.686097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.687919:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501184 00000100:00100000:3.0:1788746311.687932:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501184 00000100:00100000:3.0:1788746311.688000:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 169 00000100:00100000:3.0:1788746311.688010:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11482:x1875636141501184:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746311.688031:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.688052:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a4de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b494 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688187:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688201:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688210:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688253:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688261:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688268:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688836:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688846:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688853:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746311.688885:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788746311.688889:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746311.688906:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688917:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688925:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688931:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688950:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688955:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746311.688959:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688967:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688979:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:3.0:1788746311.688982:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746311.688987:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.688993:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a4e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.689005:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.689011:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691498:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691509:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746311.691514:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691542:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691556:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd44773e500) 00010000:00010000:3.0:1788746311.691560:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746311.691565:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691572:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a4ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691703:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a4de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691721:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 58 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.691729:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:3.0:1788746311.691731:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746311.691734:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746311.691813:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11482:x1875636141501184:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 3803us (5723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.691821:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 169 00000100:00100000:3.0:1788746311.700051:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb44700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163520128:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746311.700947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.701138:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501312 00000100:00100000:2.0:1788746311.701157:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501312 00000100:00100000:0.0:1788746311.701592:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 170 00000100:00100000:0.0:1788746311.701604:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11484:x1875636141501312:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788746311.701653:0:5849:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788746311.701796:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11484:x1875636141501312:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 194us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.701804:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 170 00000100:00100000:2.0:1788746311.710349:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.710443:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501440 00000100:00100000:0.0:1788746311.710452:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501440 00000100:00100000:0.0:1788746311.710509:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:0.0:1788746311.710519:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11484:x1875636141501440:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788746311.710587:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710603:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710640:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710666:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710673:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710679:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710701:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710708:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710714:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746311.710750:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788746311.710754:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746311.710792:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710803:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710810:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710827:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710833:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.710837:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710984:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.710997:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:0.0:1788746311.711000:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.711006:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711013:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a4fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711026:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711032:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711037:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711042:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.711045:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711060:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711134:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9cd444412100) 00010000:00010000:0.0:1788746311.711138:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.711142:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711148:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a501 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711163:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711169:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711174:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711179:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.711182:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711188:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711195:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:0.0:1788746311.711197:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.711200:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.711214:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746311.711285:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11484:x1875636141501440:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 Request processed in 767us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.711293:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:3.0:1788746311.718687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.719093:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501696 00000100:00100000:0.0:1788746311.719102:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501696 00000100:00100000:0.0:1788746311.719162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 172 00000100:00100000:0.0:1788746311.719172:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11484:x1875636141501696:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746311.719190:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746311.719222:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a50f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b49b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719312:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719325:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719336:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746311.719346:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788746311.719454:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719462:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719484:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719490:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.719495:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719502:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719512:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:0.0:1788746311.719515:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746311.719520:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719526:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719569:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a50f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b49b expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719579:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:0.0:1788746311.719581:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746311.719584:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a50f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b49b expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.719593:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9000, rc 0) 00000100:00100000:0.0:1788746311.719823:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141501696:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 652us (1144us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1788746311.719840:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 172 00000100:00100000:1.0:1788746311.736651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.736982:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141501824 00000100:00100000:0.0:1788746311.736993:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141501824 00000100:00100000:0.0:1788746311.737050:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 173 00000100:00100000:0.0:1788746311.737061:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141501824:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788746311.737106:0:5850:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788746311.737231:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141501824:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 171us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.737239:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 173 00000100:00100000:2.0:1788746311.751093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.751394:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502080 00000100:00100000:3.0:1788746311.751436:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502080 00000100:00100000:3.0:1788746311.751502:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 174 00000100:00100000:3.0:1788746311.751512:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141502080:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746311.751532:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.751535:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788746311.751560:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400c00/0xe59b64da5b30a4d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b48d expref: 58 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.751581:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:3.0:1788746311.751586:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746311.751599:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a524 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746311.752002:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788746311.752797:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a52b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.752813:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.752826:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.752895:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a524 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a2 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.752911:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a52b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a2 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.752918:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1acb00) 00010000:00010000:2.0:1788746311.752920:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746311.752923:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45c00, rc 0) 00000100:00100000:2.0:1788746311.752989:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11484:x1875636141502080:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 1478us (1904us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788746311.752997:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 174 00000100:00100000:1.0:1788746311.757999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.758108:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502336 00000100:00100000:0.0:1788746311.758121:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502336 00000100:00100000:0.0:1788746311.758189:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 175 00000100:00100000:0.0:1788746311.758211:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11484:x1875636141502336:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788746311.758267:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746311.758296:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30a52b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a2 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758314:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1acb00) 00010000:00010000:0.0:1788746311.758324:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746311.758346:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758358:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758369:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758449:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758458:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758465:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758541:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758549:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758556:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758562:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.758566:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758575:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758584:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746311.758587:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.758591:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758598:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a539 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758614:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758633:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758639:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758654:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746311.758658:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758665:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758673:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5823aa23 (ffff9cd444412100) 00010000:00010000:0.0:1788746311.758675:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746311.758678:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.758683:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5823aa23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746311.758764:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141502336:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 564us (772us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746311.758771:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 175 00000100:00100000:1.0:1788746311.789011:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.789107:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502464 00000100:00100000:2.0:1788746311.789117:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502464 00000100:00100000:2.0:1788746311.789175:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 176 00000100:00100000:2.0:1788746311.789184:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11484:x1875636141502464:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746311.789203:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746311.789237:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4a9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789271:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789284:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789296:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789380:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789440:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.789448:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:2.0:1788746311.789450:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746311.789453:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44c00, rc 0) 00000100:00100000:2.0:1788746311.789524:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11484:x1875636141502464:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 340us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746311.789531:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 176 00000100:00100000:2.0:1788746311.792694:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.792778:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502720 00000100:00100000:0.0:1788746311.792787:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502720 00000100:00100000:0.0:1788746311.792843:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 177 00000100:00100000:0.0:1788746311.792867:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11484:x1875636141502720:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788746311.792943:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.792959:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.792969:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746311.793240:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788746311.793249:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386197850264ns, next at 387197848329ns, rc = 0 00000004:00010000:0.0:1788746311.793328:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000080ce774e reply state 000000003374da42 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746311.793337:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788746311.793454:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11484:x1875636141502720:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 588us (767us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788746311.793462:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 177 00010000:00010000:1.0:1788746311.802777:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802795:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802803:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802810:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746311.802816:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802825:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802851:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:1.0:1788746311.802854:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746311.802859:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.802882:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a555 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746311.812725:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.812899:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502848 00000100:00100000:0.0:1788746311.812909:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502848 00000100:00100000:0.0:1788746311.812962:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 178 00000100:00100000:0.0:1788746311.812972:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11484:x1875636141502848:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746311.812995:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746311.813025:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.813095:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.813130:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746311.813151:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:0.0:1788746311.813154:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746311.813158:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9000, rc 0) 00000100:00100000:0.0:1788746311.813226:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11484:x1875636141502848:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 255us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.813234:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 178 00000100:00100000:3.0:1788746311.822658:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.823949:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141502976 00000100:00100000:0.0:1788746311.823960:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141502976 00000100:00100000:0.0:1788746311.824025:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:0.0:1788746311.824035:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2350:x1875636141502976:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788746311.824877:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141502976:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 840us (2231us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788746311.824886:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:0.0:1788746311.827905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.827998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141503232 00000100:00100000:3.0:1788746311.828008:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141503232 00000100:00100000:3.0:1788746311.828061:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:3.0:1788746311.828081:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11484:x1875636141503232:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746311.828491:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11484:x1875636141503232:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 419us (591us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788746311.828500:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:3.0:1788746311.839169:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.839200:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141503488 00000100:00100000:3.0:1788746311.839209:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141503488 00000100:00100000:3.0:1788746311.839254:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 179 00000100:00100000:3.0:1788746311.839264:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11484:x1875636141503488:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788746311.839373:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11484:x1875636141503488:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.839381:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 179 00000100:00100000:3.0:1788746311.842178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.842214:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141503616 00000100:00100000:3.0:1788746311.842223:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141503616 00000100:00100000:3.0:1788746311.842286:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 180 00000100:00100000:3.0:1788746311.842296:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11484:x1875636141503616:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746311.842314:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.842333:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4b7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842418:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842432:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842443:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746311.842479:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746311.842496:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842520:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b7 expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842536:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b7 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.842558:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746311.842562:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788746311.842566:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:3.0:1788746311.842612:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+63:11484:x1875636141503616:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 317us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.842635:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 180 00000100:00100000:3.0:1788746311.845709:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.845741:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141503744 00000100:00100000:3.0:1788746311.845748:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141503744 00000100:00100000:3.0:1788746311.845797:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:3.0:1788746311.845805:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141503744:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746311.845821:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746311.845838:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4be expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746311.845861:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1a48, blocks: 0x1 00010000:00010000:3.0:1788746311.845876:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1788746311.845881:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746311.845888:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.845904:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.845916:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746311.845965:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141503744:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 161us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.845972:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:2.0:1788746311.851933:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.852150:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504000 00000100:00100000:3.0:1788746311.852161:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504000 00000100:00100000:3.0:1788746311.852207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 181 00000100:00100000:3.0:1788746311.852217:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+63:11484:x1875636141504000:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788746311.852326:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+63:11484:x1875636141504000:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 109us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746311.852333:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 181 00000100:00100000:3.0:1788746311.858178:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.858278:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504128 00000100:00100000:2.0:1788746311.858287:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504128 00000100:00100000:2.0:1788746311.858349:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:2.0:1788746311.858371:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+8:11484:x1875636141504128:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746311.858390:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746311.858438:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4c5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.858473:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.858484:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746311.858488:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746311.858494:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.858527:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.858540:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746311.858554:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875636163520256:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746311.858668:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446bba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746311.864523:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875636163520256:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746311.864561:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746311.864600:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746311.864679:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:11484:x1875636141504128:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 6309us (6509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746311.864687:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:2.0:1788746311.874237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746311.874314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504256 00000100:00100000:3.0:1788746311.874324:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504256 00010000:00010000:3.0:1788746311.874360:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746311.874434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:3.0:1788746311.874444:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141504256:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746311.874458:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746311.874480:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.874493:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.874516:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a571 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4be expref: 9 pid: 6681 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.874541:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746311.874545:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746311.874553:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.874577:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.874614:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746311.874640:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1875636163520384:192.168.206.24@tcp:105: 00000100:00100000:3.0:1788746311.874727:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746311.885127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.885154:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504384 00000100:00100000:2.0:1788746311.885162:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504384 00002000:00100000:2.0:1788746311.885208:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cd45f7c5500 x1875636141504384/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:322/0 lens 504/0 e 0 to 0 dl 1788746322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746311.885219:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f7c5500 with x1875636141504384 ext(0->8) 00002000:00010000:2.0:1788746311.885240:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f7c5500 00000100:00100000:2.0:1788746311.885267:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:2.0:1788746311.885277:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2349:x1875636141504384:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788746311.885749:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1875636163520384:192.168.206.24@tcp:105: 00010000:00010000:1.0:1788746311.885784:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746311.885839:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2350:x1875636141504256:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 11396us (11622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746311.885849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:2.0:1788746311.886009:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141504384:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 Request processed in 733us (891us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788746311.886016:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00002000:00100000:2.0:1788746311.886023:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cd45f7c5500 x1875636141504384/t4294967314(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:322/0 lens 504/448 e 0 to 0 dl 1788746322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746311.886032:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f7c5500 with x1875636141504384 ext(0->8) 00002000:00010000:2.0:1788746311.886036:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f7c5500 00000100:00100000:2.0:1788746311.895527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746311.897823:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504512 00000100:00100000:0.0:1788746311.897840:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504512 00000100:00100000:0.0:1788746311.898735:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 182 00000100:00100000:0.0:1788746311.898748:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+63:11484:x1875636141504512:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788746311.951885:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+63:11484:x1875636141504512:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 Request processed in 53133us (56358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746311.951899:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 182 00000001:00080000:2.0:1788746311.952256:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788746311.952268:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:0.0:1788746311.956111:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746311.956179:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163520512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788746311.956242:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788746311.956515:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788746311.956531:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd451199900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788746311.956536:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd442c2eb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd4454dee40 00000020:00080000:2.0:1788746311.956539:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd45f76c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd344bc4400 00000001:00080000:2.0:1788746311.956566:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:2.0:1788746311.956606:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788746311.956621:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163520640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788746311.956663:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746311.956769:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163520512 00000100:00100000:3.0:1788746311.956777:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163520512 00000100:00100000:3.0:1788746311.956824:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163520640 00000100:00100000:3.0:1788746311.956827:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163520640 00000100:00100000:3.0:1788746311.956847:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746311.956856:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163520512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788746311.956993:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788746311.956997:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788746312 00002000:00010000:3.0:1788746311.956999:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788746311.957001:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788746312 -> 1788746312 00002000:00010000:3.0:1788746311.957004:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788746311.957041:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163520512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (798us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788746311.957053:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788746311.957068:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788746311.957074:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163520640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788746311.957086:0:6681:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788746311.957108:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e1a46, atime: 0x6a9e1a46, ctime: 0x6a9e1a46, blocks: 0x1 00010000:00010000:3.0:1788746311.957116:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.957232:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1788746311.957237:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746311.957244:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.957260:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.957268:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.957288:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746311.957306:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788746311.957615:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788746311.957711:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746311.957730:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504640 00000100:00100000:2.0:1788746311.957734:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504640 00000100:00100000:2.0:1788746311.957754:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:2.0:1788746311.957760:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2350:x1875636141504640:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788746311.957791:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163520640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 716us (1127us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788746311.957797:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788746311.958104:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788746311.958136:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45fb0a680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788746311.958142:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163520640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788746311.958163:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd47d08f800/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788746311.958167:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163520512:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788746311.958240:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746311.958248:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.958258:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746311.958262:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.958314:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.958332:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.958338:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41c1b3f/0xe59b64da5b30a57f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746311.958354:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746311.958361:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746311.958363:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746312.026419:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788746312.026436:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1788746312.026448:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788746312.026584:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141504640:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 Request processed in 68818us (68869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746312.026595:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:0.0:1788746312.037990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.038323:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141504896 00000100:00100000:3.0:1788746312.038335:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141504896 00000100:00100000:3.0:1788746312.038421:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 183 00000100:00100000:3.0:1788746312.038432:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11484:x1875636141504896:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788746312.038483:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746312.038509:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a56a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b7 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.038529:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746312.038534:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746312.038570:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.038585:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.038595:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746312.038868:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c15d701e reply state 0000000056e12977 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.038878:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746312.038980:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11484:x1875636141504896:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 550us (999us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788746312.038988:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 183 00000100:00100000:0.0:1788746312.043178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746312.043211:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505024 00000100:00100000:0.0:1788746312.043220:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505024 00000100:00100000:0.0:1788746312.043276:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00100000:0.0:1788746312.043286:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141505024:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788746312.043549:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788746312.043552:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788746312 -> 1788746311 00002000:00010000:0.0:1788746312.043554:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788746310 00002000:00010000:0.0:1788746312.043556:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788746312 -> 1788746311 00002000:00010000:0.0:1788746312.043558:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788746312.043608:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141505024:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 323us (438us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788746312.043639:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00080000:0.0:1788746312.043680:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788746312.044192:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044203:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044210:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044217:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746312.044221:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044228:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044244:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:1.0:1788746312.044247:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746312.044252:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.044258:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746312.046076:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.046968:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505280 00000100:00100000:3.0:1788746312.046979:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505280 00000100:00100000:3.0:1788746312.047035:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 184 00000100:00100000:3.0:1788746312.047046:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11484:x1875636141505280:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788746312.047108:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.047125:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.047134:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.047167:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.047182:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 18 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.047196:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163520768:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746312.047275:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746312.053964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.054492:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163520768:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746312.054518:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.055332:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505408 00000100:00100000:0.0:1788746312.055342:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505408 00010000:00010000:0.0:1788746312.055381:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.055456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 67 00000100:00100000:0.0:1788746312.055466:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:2350:x1875636141505408:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746312.055483:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746312.055490:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055503:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055524:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30a54e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4a9 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055538:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:0.0:1788746312.055544:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055553:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055561:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.055591:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746312.055870:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055878:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055910:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055917:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055923:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055929:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746312.055933:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055939:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055948:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746312.055950:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788746312.055954:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.055960:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a58d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.056027:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2350:x1875636141505408:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 561us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746312.056035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 67 00000100:00100000:3.0:1788746312.065502:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+17:11484:x1875636141505280:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 Request processed in 18448us (19423us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788746312.065516:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 184 00000100:00100000:0.0:1788746312.072344:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.072442:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505536 00000100:00100000:3.0:1788746312.072452:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505536 00000100:00100000:3.0:1788746312.072504:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:3.0:1788746312.072527:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2347:x1875636141505536:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788746312.072569:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.072588:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.072596:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746312.072600:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746312.072604:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.072654:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.072668:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 8 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.072681:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163520896:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746312.072744:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746312.074582:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163520896:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746312.074604:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.076528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746312.076606:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505664 00000100:00100000:2.0:1788746312.076616:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505664 00010000:00010000:2.0:1788746312.076668:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746312.076701:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:2.0:1788746312.076711:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd461dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141505664:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746312.076726:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746312.076747:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.076772:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.076814:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af14e5f1/0xe59b64da5b30a578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4c5 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.076830:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746312.076835:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746312.076841:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.076850:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.076876:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746312.076932:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd461dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141505664:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 222us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746312.076940:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 68 00010000:00010000:3.0:1788746312.077097:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077114:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077140:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077150:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077158:0:8456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077166:0:8456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746312.077170:0:8456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077179:0:8456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077192:0:8456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.077199:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4abe1/0xe59b64da5b30a594 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.077256:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141505536:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 Request processed in 4730us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746312.077265:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:0.0:1788746312.081290:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.081376:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141505920 00000100:00100000:3.0:1788746312.081388:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141505920 00000100:00100000:3.0:1788746312.081472:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 185 00000100:00100000:3.0:1788746312.081482:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+17:11484:x1875636141505920:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788746312.081563:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081581:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081593:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081936:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081948:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081956:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.081988:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.082020:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 18 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.082034:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521024:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746312.082155:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788746312.087366:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521024:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746312.087394:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746312.092296:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746312.096489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141506048 00000100:00100000:1.0:1788746312.096503:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141506048 00010000:00010000:1.0:1788746312.096543:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746312.096599:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:1.0:1788746312.096610:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+19:2349:x1875636141506048:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746312.096636:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746312.096652:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096664:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a55c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4b0 expref: 19 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096701:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:1.0:1788746312.096707:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096716:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096724:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096748:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746312.096807:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2349:x1875636141506048:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 199us (4582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746312.096814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 69 00010000:00010000:1.0:1788746312.096837:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.096850:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788746312.097017:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788746312.097153:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788746312.097199:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788746312.097273:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd476fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163521152:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788746312.097357:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746312.097385:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746312.097436:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163521152 00000100:00100000:1.0:1788746312.097441:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163521152 00000100:00100000:1.0:1788746312.097472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746312.097479:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163521152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788746312.098341:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163521152:12345-0@lo:1000:mdt00_001.0 Request processed in 860us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746312.098349:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788746312.100857:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788746312.100869:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd47d08f800, transno 4294967315 00000100:00100000:3.0:1788746312.100894:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd476fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163521152:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788746312.101365:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788746312.101459:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163521280:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788746312.101513:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746312.101544:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746312.102555:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163521280 00000100:00100000:1.0:1788746312.102563:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163521280 00000100:00100000:1.0:1788746312.102867:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746312.102881:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875636163521280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788746312.103081:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875636163521280:12345-0@lo:1000:mdt00_001.0 Request processed in 204us (1567us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788746312.103089:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788746312.103895:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875636163521280:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788746312.103932:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.103943:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.103950:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.103967:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746312.103971:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.103980:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.103995:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac700) 00010000:00010000:3.0:1788746312.103998:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746312.104002:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104009:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a5a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104037:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104043:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104050:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104055:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746312.104058:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104063:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104084:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:3.0:1788746312.104087:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746312.104090:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104096:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a4d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104116:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104130:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104139:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104169:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.104184:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 21 pid: 8618 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.104197:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521408:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746312.104871:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746312.112321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746312.112954:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141506176 00000100:00100000:1.0:1788746312.112965:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141506176 00010000:00010000:1.0:1788746312.113019:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 22 pid: 8618 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746312.113083:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:1.0:1788746312.113094:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+22:2349:x1875636141506176:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746312.113111:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746312.113119:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 22 pid: 8618 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.113132:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 22 pid: 8618 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.113170:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:1.0:1788746312.113175:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.113185:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.113193:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.113212:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746312.113270:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+22:2349:x1875636141506176:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 177us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746312.113277:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 70 00010000:00010000:3.0:1788746312.114304:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a4f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b494 expref: 21 pid: 8618 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.114324:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521408:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746312.114357:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114366:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114372:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114384:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114391:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114602:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114609:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746312.114685:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114695:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114708:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:3.0:1788746312.114711:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746312.114715:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114722:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a5a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114744:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114751:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114826:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114833:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746312.114837:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114843:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114851:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412500) 00010000:00010000:3.0:1788746312.114854:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746312.114857:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.114863:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a59b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.115169:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11484:x1875636141505920:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 33686us (33886us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788746312.115179:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 185 00000020:00080000:3.0:1788746312.115184:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788746312.117744:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.117875:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141506432 00000100:00100000:3.0:1788746312.117885:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141506432 00000100:00100000:3.0:1788746312.117948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:3.0:1788746312.117958:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450cec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11484:x1875636141506432:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788746312.118911:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746312.118917:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746312.119533:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788746312.119542:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1788746312.120208:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788746312.120362:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1788746312.120555:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120572:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120585:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120601:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120607:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120684:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.120743:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788746312.120857:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450cec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+22:11484:x1875636141506432:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 2897us (3119us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788746312.120866:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 50 00000020:00080000:2.0:1788746312.120871:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788746312.133166:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746312.133181:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.133192:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746312.133197:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.133207:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.133224:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cd46e1ac500) 00010000:00010000:0.0:1788746312.133237:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788746312.133243:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.133249:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30a5b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.133318:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746312.133320:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746312.133322:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746312.191043:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746312.622967:0:12447:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746312.622975:0:12447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746312.623013:0:12447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788746312.623019:0:12447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746312.795330:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746312.796043:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141506688 00000100:00100000:1.0:1788746312.796055:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141506688 00000100:00100000:1.0:1788746312.796110:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 186 00000100:00100000:1.0:1788746312.796120:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+22:11503:x1875636141506688:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746312.796314:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746312.796377:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a5b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4cc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.797707:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a5be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.797726:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a5be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.797740:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a5be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746312.797752:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788746312.798388:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4cc expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.798687:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4cc expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.798697:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746312.798700:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788746312.798705:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401c00, rc 0) 00000100:00100000:3.0:1788746312.802883:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+24:11503:x1875636141506688:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 6753us (7550us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788746312.802896:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 186 00000100:00100000:1.0:1788746312.805543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746312.805755:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141506816 00000100:00100000:0.0:1788746312.805766:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141506816 00000100:00100000:0.0:1788746312.805821:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 187 00000100:00100000:0.0:1788746312.805832:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+24:11503:x1875636141506816:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:0.0:1788746312.805904:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.805920:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.805931:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.805988:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.805997:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806004:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806579:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806590:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806605:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746312.806724:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806736:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806743:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806750:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806756:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746312.806760:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806767:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806778:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746312.806781:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746312.806786:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806792:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a5cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806804:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806815:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806821:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806826:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746312.806829:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806836:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806844:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412300) 00010000:00010000:0.0:1788746312.806846:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746312.806849:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806855:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806870:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806875:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806881:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806886:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746312.806895:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806902:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806909:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd444412b00) 00010000:00010000:0.0:1788746312.806911:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746312.806914:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.806919:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a5da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.807040:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+24:11503:x1875636141506816:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 1209us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746312.807049:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 187 00000100:00100000:3.0:1788746312.853999:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746312.854124:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141507072 00000100:00100000:1.0:1788746312.854133:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141507072 00000100:00100000:1.0:1788746312.854217:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 188 00000100:00100000:1.0:1788746312.854228:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+24:11506:x1875636141507072:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746312.854247:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746312.854273:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a5e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4d3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854340:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854367:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854378:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854393:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854418:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.854425:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.855893:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.855911:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.855922:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746312.855946:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788746312.856036:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856055:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856062:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856068:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746312.856073:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856080:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856091:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746312.856094:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746312.856099:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856105:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856120:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856126:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856132:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856137:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746312.856145:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856305:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856315:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511adc00) 00010000:00010000:1.0:1788746312.856318:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746312.856322:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856328:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856376:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a5e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856391:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.856485:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746312.856488:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746312.856491:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401400, rc 0) 00000100:00100000:1.0:1788746312.856857:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11506:x1875636141507072:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 2629us (2863us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788746312.856866:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 188 00000100:00100000:0.0:1788746312.865886:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746312.865981:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141507200 00000100:00100000:1.0:1788746312.865991:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141507200 00000100:00100000:1.0:1788746312.866047:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 189 00000100:00100000:1.0:1788746312.866058:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11506:x1875636141507200:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746312.866129:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866145:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866156:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866179:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866186:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866193:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866198:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746312.866201:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866208:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866218:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746312.866221:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746312.866225:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746312.866230:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746312.866309:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11506:x1875636141507200:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 253us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746312.866317:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 189 00000100:00100000:3.0:1788746312.875776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746312.876266:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141507456 00000100:00100000:0.0:1788746312.876724:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141507456 00000100:00100000:0.0:1788746312.876780:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:0.0:1788746312.876790:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11506:x1875636141507456:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746312.877926:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+27:11506:x1875636141507456:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 1134us (2153us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788746312.877936:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:0.0:1788746312.922381:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.922477:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141507712 00000100:00100000:3.0:1788746312.922486:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141507712 00000100:00100000:3.0:1788746312.922550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 190 00000100:00100000:3.0:1788746312.922560:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+27:11040:x1875636141507712:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746312.922583:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746312.922602:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a60b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.922723:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.922737:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.922746:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.922794:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.922808:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 28 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.922822:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163521536:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746312.922914:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dccf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746312.925441:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875636163521536:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746312.925471:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.925882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.927209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141507840 00000100:00100000:3.0:1788746312.927221:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141507840 00010000:00010000:3.0:1788746312.927271:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 29 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746312.927314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 71 00000100:00100000:3.0:1788746312.927323:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+29:2350:x1875636141507840:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746312.927336:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746312.927343:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 29 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927356:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 29 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927394:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a5f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4d3 expref: 29 pid: 5851 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927432:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:3.0:1788746312.927437:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927447:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927453:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.927478:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746312.927527:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+28:2350:x1875636141507840:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 205us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746312.927535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 71 00010000:00010000:3.0:1788746312.928743:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.928755:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746312.928832:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788746312.928969:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a60b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.928986:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.929007:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:3.0:1788746312.929010:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788746312.929014:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:3.0:1788746312.929309:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+28:11040:x1875636141507712:12345-192.168.206.24@tcp:101:bash.0 Request processed in 6749us (6934us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788746312.929318:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 190 00000100:00100000:0.0:1788746312.932117:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.932255:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508096 00000100:00100000:3.0:1788746312.932265:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508096 00000100:00100000:3.0:1788746312.932316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 191 00000100:00100000:3.0:1788746312.932326:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+28:11040:x1875636141508096:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:0.0:1788746312.932971:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.932999:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746312.933011:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746312.933063:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1788746312.933087:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002a60dc24 reply state 0000000059d30891 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746312.933096:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788746312.933224:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1788746312.933364:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11040:x1875636141508096:12345-192.168.206.24@tcp:36:bash.0 Request processed in 1036us (1253us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788746312.933372:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 191 00000020:00080000:0.0:1788746312.933377:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788746312.936259:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936278:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936286:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936292:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746312.936297:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936305:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936340:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:2.0:1788746312.936343:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746312.936348:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.936354:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9600/0xe59b64da5b30a620 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746312.936842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.936958:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508224 00000100:00100000:3.0:1788746312.936967:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508224 00000100:00100000:3.0:1788746312.937060:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 192 00000100:00100000:3.0:1788746312.937073:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11040:x1875636141508224:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746312.937096:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746312.937117:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4e1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.937194:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e1 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.937208:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e1 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746312.937229:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:3.0:1788746312.937242:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746312.937246:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940e00, rc 0) 00000100:00100000:3.0:1788746312.937349:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11040:x1875636141508224:12345-192.168.206.24@tcp:101:bash.0 Request processed in 279us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746312.937356:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 192 00000100:00100000:3.0:1788746312.940116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746312.940278:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508352 00000100:00100000:2.0:1788746312.940287:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508352 00000100:00100000:2.0:1788746312.940340:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:2.0:1788746312.940351:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:11040:x1875636141508352:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746312.940367:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746312.940387:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4e8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746312.940434:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e1a47, atime: 0x6a9e1a46, ctime: 0x6a9e1a47, blocks: 0xb 00010000:00010000:2.0:1788746312.940456:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788746312.940460:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746312.940468:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.940485:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746312.940498:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45c00, rc 0) 00000100:00100000:2.0:1788746312.940559:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:11040:x1875636141508352:12345-192.168.206.24@tcp:101:bash.0 Request processed in 209us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746312.940577:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:0.0:1788746312.942517:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746312.942649:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508480 00000100:00100000:3.0:1788746312.942659:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508480 00002000:00010000:3.0:1788746312.942695:0:6686:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788746312.942700:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45fb52300 with x1875636141508480 ext(0->18446744073709551615) 00002000:00010000:3.0:1788746312.942712:0:6686:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45fb52300. 00000100:00100000:3.0:1788746312.942739:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:3.0:1788746312.942748:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141508480:12345-192.168.206.24@tcp:10:bash.0 00002000:00010000:3.0:1788746312.943001:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788746312.943005:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788746311 -> 1788746313 00002000:00010000:3.0:1788746312.943007:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788746310 -> 1788746310 00002000:00010000:3.0:1788746312.943010:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788746311 -> 1788746313 00002000:00010000:3.0:1788746312.943012:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788746312.943071:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141508480:12345-192.168.206.24@tcp:10:bash.0 Request processed in 323us (560us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788746312.943080:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00002000:00010000:3.0:1788746312.943085:0:6686:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788746312.943088:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45fb52300 with x1875636141508480 ext(0->18446744073709551615) 00002000:00010000:3.0:1788746312.943092:0:6686:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45fb52300. 00000100:00100000:2.0:1788746313.017625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.017779:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508608 00000100:00100000:0.0:1788746313.017790:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508608 00000100:00100000:0.0:1788746313.017865:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 193 00000100:00100000:0.0:1788746313.017876:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11520:x1875636141508608:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:0.0:1788746313.017944:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.017961:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.017972:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018005:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018013:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018020:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018269:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018279:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018287:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746313.018325:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018337:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018344:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018351:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018357:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746313.018360:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018374:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018388:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746313.018391:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:2.0:1788746313.018847:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788746313.018886:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018895:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a635 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018912:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018918:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018923:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018928:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746313.018931:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018936:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018944:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412b00) 00010000:00010000:0.0:1788746313.018947:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746313.018950:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018967:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a63c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018983:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018988:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018993:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.018998:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746313.019001:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.019006:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.019014:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:0.0:1788746313.019017:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746313.019020:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.019025:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9000/0xe59b64da5b30a643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746313.019142:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11520:x1875636141508608:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 1266us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.019150:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 193 00000100:00100000:0.0:1788746313.061187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.061501:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508864 00000100:00100000:1.0:1788746313.061512:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508864 00000100:00100000:1.0:1788746313.061570:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 194 00000100:00100000:1.0:1788746313.061581:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+32:11523:x1875636141508864:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746313.061600:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.061633:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a64a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061714:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061730:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061742:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061768:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061776:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.061783:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062042:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062052:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062059:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746313.062069:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788746313.062159:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062167:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062174:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062179:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.062184:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062191:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062202:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.062205:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.062210:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062243:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062262:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062268:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062274:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062279:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.062282:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062288:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062296:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511adc00) 00010000:00010000:1.0:1788746313.062298:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.062302:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062307:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062346:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a64a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4ef expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062361:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4ef expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.062374:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.062377:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788746313.062379:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401400, rc 0) 00000100:00100000:1.0:1788746313.062521:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11523:x1875636141508864:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 942us (1342us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788746313.062530:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 194 00000100:00100000:2.0:1788746313.066370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.066515:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141508992 00000100:00100000:1.0:1788746313.066524:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141508992 00000100:00100000:1.0:1788746313.066568:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 195 00000100:00100000:1.0:1788746313.066578:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11523:x1875636141508992:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746313.066658:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.066675:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.066684:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.066718:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.066732:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 34 pid: 5849 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.066746:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521664:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746313.066861:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746313.069104:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd4802a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163521664:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746313.069129:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746313.070257:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.070680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141509248 00000100:00100000:3.0:1788746313.070689:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141509248 00000100:00100000:3.0:1788746313.070763:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:3.0:1788746313.070774:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:5588:x1875636141509248:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788746313.071111:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+36:5588:x1875636141509248:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 338us (859us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788746313.071120:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:0.0:1788746313.074018:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.074085:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141509376 00000100:00100000:1.0:1788746313.074095:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141509376 00010000:00010000:1.0:1788746313.074133:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 36 pid: 5849 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.074236:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 72 00000100:00100000:1.0:1788746313.074247:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+36:2349:x1875636141509376:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746313.074262:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.074269:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 36 pid: 5849 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074282:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 36 pid: 5849 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074303:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a612 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4da expref: 36 pid: 5849 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074317:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.074322:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074331:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074367:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.074442:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746313.074492:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+35:2349:x1875636141509376:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 246us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.074500:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 72 00010000:00010000:0.0:1788746313.074556:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074565:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074591:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074599:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074606:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074625:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746313.074629:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074648:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074658:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:0.0:1788746313.074661:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746313.074665:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.074672:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400a00/0xe59b64da5b30a66d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746313.074711:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11523:x1875636141508992:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 8135us (8350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.074728:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 195 00000100:00100000:3.0:1788746313.077496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.077531:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141509632 00000100:00100000:3.0:1788746313.077540:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141509632 00000100:00100000:3.0:1788746313.077583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:3.0:1788746313.077593:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+34:11523:x1875636141509632:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:3.0:1788746313.077823:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:11523:x1875636141509632:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 230us (334us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788746313.077831:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:3.0:1788746313.143829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.143939:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141509888 00000100:00100000:1.0:1788746313.143949:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141509888 00000100:00100000:1.0:1788746313.144002:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 196 00000100:00100000:1.0:1788746313.144012:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+35:11534:x1875636141509888:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:1.0:1788746313.144034:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.144055:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4f6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144119:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144133:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144144:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144157:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144164:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144187:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144579:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144590:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144598:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746313.144608:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788746313.144711:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144720:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144727:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144734:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.144738:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144746:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144757:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.144761:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.144773:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144780:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a67b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144795:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144802:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144808:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144813:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.144816:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144823:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144831:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511adc00) 00010000:00010000:1.0:1788746313.144834:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.144837:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144843:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4f6 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144913:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4f6 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.144920:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.144922:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746313.144925:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400400, rc 0) 00000100:00100000:1.0:1788746313.144987:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11534:x1875636141509888:12345-192.168.206.24@tcp:101:cat.0 Request processed in 976us (1165us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788746313.144996:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 196 00000100:00100000:2.0:1788746313.146658:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163522176:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.146721:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746313.146787:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746313.146794:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163521792:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.146824:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746313.146854:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.146879:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746313.146905:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163521920:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.146926:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746313.146941:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163522432:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.147010:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746313.147027:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746313.147033:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163522048:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.147054:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746313.147123:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163522176 00000100:00100000:3.0:1788746313.147130:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163522176 00000100:00100000:3.0:1788746313.147181:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163522432 00000100:00100000:3.0:1788746313.147184:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163522432 00000100:00100000:3.0:1788746313.147209:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788746313.147217:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163522176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746313.147286:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163522176:12345-0@lo:400:kworker.0 Request processed in 70us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.147293:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788746313.147309:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788746313.147316:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163522432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746313.147344:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163522432:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.147362:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788746313.147430:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163522176:0@lo:400:kworker.0 00000100:00100000:3.0:1788746313.147485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163521792 00000100:00100000:3.0:1788746313.147489:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163521792 00000100:00100000:3.0:1788746313.147515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788746313.147521:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163521792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746313.147556:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163521792:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.147561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788746313.147596:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163521792:0@lo:400:kworker.0 00000100:00080000:3.0:1788746313.147619:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746313.147623:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746313.155112:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163522432:0@lo:400:kworker.0 00000100:00100000:0.0:1788746313.158515:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163522304 00000100:00100000:0.0:1788746313.158529:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163522304 00000100:00100000:0.0:1788746313.158602:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163521920 00000100:00100000:0.0:1788746313.158606:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163521920 00000100:00100000:0.0:1788746313.158618:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163522048 00000100:00100000:0.0:1788746313.158620:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163522048 00000100:00100000:0.0:1788746313.158648:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788746313.158659:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163522304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746313.158747:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163522304:12345-0@lo:400:kworker.0 Request processed in 90us (11866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.158754:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788746313.158769:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788746313.158775:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746313.158805:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163521920:12345-0@lo:400:kworker.0 Request processed in 31us (11878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.158811:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788746313.158845:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788746313.158852:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746313.158878:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163522048:12345-0@lo:400:kworker.0 Request processed in 28us (11824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.158883:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788746313.158926:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163522304:0@lo:400:kworker.0 00000100:00080000:2.0:1788746313.159716:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746313.159747:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163522048:0@lo:400:kworker.0 00000100:00100000:2.0:1788746313.159758:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163521920:0@lo:400:kworker.0 00000100:00100000:0.0:1788746313.161268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.161735:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141510144 00000100:00100000:3.0:1788746313.161744:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141510144 00000100:00100000:3.0:1788746313.161787:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 54 00000100:00100000:3.0:1788746313.161797:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11534:x1875636141510144:12345-192.168.206.24@tcp:35:cat.0 00000100:00100000:3.0:1788746313.162012:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+38:11534:x1875636141510144:12345-192.168.206.24@tcp:35:cat.0 Request processed in 215us (747us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788746313.162021:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 54 00000001:00080000:0.0:1788746313.195720:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788746313.195753:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788746313.201219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.201779:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141510400 00000100:00100000:0.0:1788746313.201789:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141510400 00000100:00100000:1.0:1788746313.201985:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 197 00000100:00100000:1.0:1788746313.201996:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+38:11535:x1875636141510400:12345-192.168.206.24@tcp:36:rm.0 00010000:00010000:1.0:1788746313.202048:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788746313.202074:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4f6 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202100:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4ef expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202117:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e1 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202127:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.202137:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746313.202156:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202185:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202195:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202211:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202218:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202507:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202751:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202761:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.202769:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746313.204416:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788746313.204430:0:8618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387609031177ns, next at 388609027736ns, rc = 0 00010000:00010000:1.0:1788746313.204502:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204516:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204539:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204547:0:8618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204554:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204559:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204581:0:8618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746313.204602:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204616:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204622:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204629:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.204632:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204649:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204664:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511adf00) 00010000:00010000:1.0:1788746313.204667:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788746313.204678:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204685:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a6a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204707:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204714:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204719:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204724:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.204727:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204733:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204740:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.204743:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.204750:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.204756:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a697 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746313.204766:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ada7d6c9 reply state 00000000fa9e43aa transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.204784:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788746313.204874:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+37:11535:x1875636141510400:12345-192.168.206.24@tcp:36:rm.0 Request processed in 2878us (3662us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788746313.204883:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 197 00010000:00010000:3.0:1788746313.205123:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746313.205131:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.205137:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746313.205140:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.205158:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.205167:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cd4511adf00) 00010000:00010000:3.0:1788746313.205170:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788746313.205173:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.205179:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a6ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.205197:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746313.205199:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746313.205201:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746313.208195:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208241:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208250:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208255:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746313.208260:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208268:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208283:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511adc00) 00010000:00010000:2.0:1788746313.208286:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746313.208291:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.208297:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a69e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.210837:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746313.245500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.245597:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141510656 00000100:00100000:0.0:1788746313.245607:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141510656 00000100:00100000:0.0:1788746313.245682:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 198 00000100:00100000:0.0:1788746313.245692:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+36:11541:x1875636141510656:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746313.245714:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746313.245735:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a6b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b4fd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245853:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245868:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245878:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245892:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245899:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.245906:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788746313.246525:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788746313.246702:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.246720:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.246730:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.246764:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247283:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247293:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247305:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746313.247311:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247446:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247463:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746313.247466:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746313.247471:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.247477:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746313.247492:0:5850:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e6b585f3 reply state 000000009fdff75e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746313.247510:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788746313.249908:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8c00/0xe59b64da5b30a6b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.249939:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.249947:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:1.0:1788746313.249950:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746313.249954:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8200, rc 0) 00000100:00100000:1.0:1788746313.250079:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+39:11541:x1875636141510656:12345-192.168.206.24@tcp:101:bash.0 Request processed in 4387us (4586us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788746313.250088:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 198 00000100:00100000:1.0:1788746313.259569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.259820:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141510784 00000100:00100000:3.0:1788746313.259830:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141510784 00000100:00100000:3.0:1788746313.259903:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:3.0:1788746313.259914:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141510784:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746313.259930:0:8456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746313.259949:0:8456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b504 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788746313.259973:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788746313.259991:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1788746313.259996:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746313.260004:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 6 pid: 8456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.260047:0:8456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 6 pid: 8456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.260062:0:8456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940400, rc 0) 00000100:00100000:3.0:1788746313.260112:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2347:x1875636141510784:12345-192.168.206.24@tcp:101:bash.0 Request processed in 199us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.260118:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00080000:0.0:1788746313.260201:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788746313.260594:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260604:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260620:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260626:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746313.260649:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260657:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260670:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412b00) 00010000:00010000:2.0:1788746313.260673:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746313.260678:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.260684:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8600/0xe59b64da5b30a6c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.264443:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746313.264611:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141510912 00000100:00100000:2.0:1788746313.264628:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141510912 00000100:00100000:2.0:1788746313.264706:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:2.0:1788746313.264721:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+6:11541:x1875636141510912:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:2.0:1788746313.264751:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746313.264785:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b50b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.264827:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.264842:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746313.264848:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746313.264859:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.264933:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.264953:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746313.264975:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f600e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875636163522560:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746313.265199:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446bb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746313.272848:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.272879:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f600e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875636163522560:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746313.272913:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.272933:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:3.0:1788746313.272997:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:11541:x1875636141510912:12345-192.168.206.24@tcp:101:bash.0 Request processed in 8280us (8612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.273005:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:0.0:1788746313.274442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141511040 00000100:00100000:0.0:1788746313.274455:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141511040 00010000:00010000:0.0:1788746313.274498:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746313.274543:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:0.0:1788746313.274554:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141511040:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746313.274567:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746313.274589:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.274603:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.274922:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a515bb6/0xe59b64da5b30a6d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b504 expref: 7 pid: 8456 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.274938:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746313.274942:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746313.274949:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.274958:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.275010:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746313.275451:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f5db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1875636163522688:192.168.206.24@tcp:105: 00000100:00100000:0.0:1788746313.275526:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746313.282788:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f5db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5836:1875636163522688:192.168.206.24@tcp:105: 00010000:00010000:0.0:1788746313.282826:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746313.282882:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f601880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2349:x1875636141511040:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 8329us (10043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.282893:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:1.0:1788746313.283868:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.283940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141511296 00000100:00100000:3.0:1788746313.283949:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141511296 00000100:00100000:3.0:1788746313.283989:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:3.0:1788746313.283999:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+38:11541:x1875636141511296:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:3.0:1788746313.284345:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+39:11541:x1875636141511296:12345-192.168.206.24@tcp:35:bash.0 Request processed in 347us (479us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788746313.284353:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 55 00000100:00100000:2.0:1788746313.430048:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.430222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141511424 00000100:00100000:0.0:1788746313.430241:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141511424 00000100:00100000:0.0:1788746313.430301:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 199 00000100:00100000:0.0:1788746313.430311:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+39:11557:x1875636141511424:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746313.430335:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746313.430354:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b512 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430617:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430632:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430652:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746313.430696:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788746313.430700:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746313.430715:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430739:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b512 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430936:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b512 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.430944:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746313.430947:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746313.430951:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8000, rc 0) 00000100:00100000:0.0:1788746313.431011:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11557:x1875636141511424:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 702us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746313.431019:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 199 00000100:00100000:1.0:1788746313.435070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.435258:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141511680 00000100:00100000:3.0:1788746313.435268:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141511680 00000100:00100000:3.0:1788746313.435327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 200 00000100:00100000:3.0:1788746313.435336:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+40:11557:x1875636141511680:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746313.435355:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746313.435375:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a6f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.435595:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a6f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.435610:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.435622:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746313.435645:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788746313.435880:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a6f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b519 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.435899:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b519 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.435906:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:3.0:1788746313.435909:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746313.435913:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746313.436022:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+42:11557:x1875636141511680:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 686us (961us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788746313.436046:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 200 00000100:00100000:3.0:1788746313.441562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.441671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141511808 00000100:00100000:1.0:1788746313.441680:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141511808 00000100:00100000:1.0:1788746313.441751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:1.0:1788746313.441763:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+42:2349:x1875636141511808:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746313.441777:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.441812:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a6f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b519 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.441831:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:1.0:1788746313.441835:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746313.441892:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+41:2349:x1875636141511808:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 131us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.441899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:2.0:1788746313.452321:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.452702:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512064 00000100:00100000:0.0:1788746313.452713:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512064 00000100:00100000:0.0:1788746313.452901:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 201 00000100:00100000:0.0:1788746313.452913:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+41:11557:x1875636141512064:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746313.452937:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746313.452957:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b520 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.453050:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.453095:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.453108:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746313.453122:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788746313.453258:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30a707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b520 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.453278:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b520 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746313.453286:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:0.0:1788746313.453288:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788746313.453292:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8a00, rc 0) 00000100:00100000:0.0:1788746313.453356:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+43:11557:x1875636141512064:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 446us (1042us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788746313.453363:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 201 00000100:00100000:3.0:1788746313.462141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.462366:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512192 00000100:00100000:1.0:1788746313.462375:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512192 00000100:00100000:1.0:1788746313.462526:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:1.0:1788746313.462536:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+6:2348:x1875636141512192:12345-192.168.206.24@tcp:1:lfs.0 00010000:00010000:1.0:1788746313.462581:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.462613:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.462622:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746313.462627:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746313.462631:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.462678:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.462703:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 6 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.462730:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd446269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8456:1875636163522816:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746313.462824:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788746313.470086:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.470376:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd446269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8456:1875636163522816:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746313.470426:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746313.476548:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512320 00000100:00100000:2.0:1788746313.476566:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512320 00002000:00100000:2.0:1788746313.476652:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cd477456300 x1875636141512320/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:324/0 lens 504/0 e 0 to 0 dl 1788746324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746313.476664:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477456300 with x1875636141512320 ext(0->8) 00010000:00010000:2.0:1788746313.476675:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 7 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.476693:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 7 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746313.476700:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd477456300 00000100:00100000:2.0:1788746313.476734:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:2.0:1788746313.476888:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141512320:12345-192.168.206.24@tcp:4:lfs.0 00000100:00100000:2.0:1788746313.477457:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2349:x1875636141512320:12345-192.168.206.24@tcp:4:lfs.0 Request processed in 572us (7377us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788746313.477466:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00002000:00100000:2.0:1788746313.477473:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cd477456300 x1875636141512320/t4294967308(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:324/0 lens 504/448 e 0 to 0 dl 1788746324 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788746313.477483:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477456300 with x1875636141512320 ext(0->8) 00010000:00010000:2.0:1788746313.477490:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.477504:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746313.477511:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cd477456300 00000100:00100000:2.0:1788746313.483197:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.484957:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512448 00000100:00100000:3.0:1788746313.484979:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512448 00010000:00010000:3.0:1788746313.485021:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.485052:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 74 00000100:00100000:3.0:1788746313.485061:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd461dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2348:x1875636141512448:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746313.485075:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788746313.485207:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788746313.485211:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788746314 00002000:00010000:3.0:1788746313.485214:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788746314 00002000:00010000:3.0:1788746313.485216:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788746314 00010000:00010000:3.0:1788746313.485223:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.485236:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.485436:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af14e5f1/0xe59b64da5b30a6dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b50b expref: 9 pid: 6681 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.485453:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746313.485471:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746313.485477:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.485487:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.485578:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746313.485670:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd461dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2348:x1875636141512448:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 609us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.485679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 74 00010000:00010000:1.0:1788746313.485770:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485779:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485809:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485817:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485825:0:8456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485832:0:8456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746313.485837:0:8456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485859:0:8456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485873:0:8456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.485905:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008765db52/0xe59b64da5b30a71c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.486026:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2348:x1875636141512192:12345-192.168.206.24@tcp:1:lfs.0 Request processed in 23439us (23841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.486034:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:2.0:1788746313.490466:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.490592:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512704 00000100:00100000:3.0:1788746313.490601:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512704 00000100:00100000:3.0:1788746313.490673:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 56 00000100:00100000:3.0:1788746313.490683:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450cee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+43:11557:x1875636141512704:12345-192.168.206.24@tcp:35:lfs.0 00000004:00010000:3.0:1788746313.490744:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b520 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746313.490975:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788746313.491021:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788746313.491302:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1788746313.491352:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.491368:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.491377:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.491473:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.491489:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 47 pid: 5850 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.491501:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875636163522944:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746313.491576:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746313.494829:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.494898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512832 00000100:00100000:1.0:1788746313.494907:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512832 00010000:00010000:1.0:1788746313.494943:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 48 pid: 5850 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.494982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:1.0:1788746313.494991:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:2350:x1875636141512832:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746313.495006:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.495013:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 48 pid: 5850 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.495025:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 48 pid: 5850 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.495066:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:1.0:1788746313.495071:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.495080:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.495088:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.495106:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746313.495166:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+48:2350:x1875636141512832:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 176us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.495173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 75 00010000:00010000:3.0:1788746313.495254:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30a6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4fd expref: 47 pid: 5850 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.495270:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875636163522944:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746313.495289:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.495298:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.495303:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788746313.495452:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788746313.495651:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788746313.495757:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163523072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788746313.495802:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746313.495832:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746313.495898:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163523072 00000100:00100000:1.0:1788746313.495904:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163523072 00000100:00100000:1.0:1788746313.495941:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746313.495949:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163523072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788746313.496010:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163523072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.496016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746313.496215:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788746313.496238:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788746313.496263:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45fb0a680, transno 4294967307 00000100:00100000:3.0:1788746313.496880:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477456a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163523072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788746313.497429:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788746313.497499:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163523200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788746313.497545:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746313.497567:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746313.497775:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163523200 00000100:00100000:0.0:1788746313.497782:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163523200 00000100:00100000:0.0:1788746313.497825:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788746313.497834:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875636163523200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788746313.497997:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875636163523200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 164us (451us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788746313.498005:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788746313.498107:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875636163523200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788746313.498150:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788746313.498183:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498192:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498199:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498213:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746313.498217:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498237:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498251:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:2.0:1788746313.498254:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788746313.498259:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.498265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a723 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788746313.498451:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788746313.498535:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788746313.498545:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387903145434ns, next at 388903143696ns, rc = 0 00000001:00080000:2.0:1788746313.498550:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788746313.498579:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd444412300) 00010000:00010000:2.0:1788746313.498582:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788746313.498588:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a70e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b520 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746313.498699:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450cee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:11557:x1875636141512704:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 8017us (8241us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788746313.498706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 56 00000020:00080000:2.0:1788746313.498710:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788746313.503935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.504663:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141512960 00000100:00100000:3.0:1788746313.504675:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141512960 00000100:00100000:3.0:1788746313.504725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 202 00000100:00100000:3.0:1788746313.504736:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+50:11557:x1875636141512960:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746313.504771:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746313.504794:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a72a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.504850:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a72a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b527 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.504865:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a72a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b527 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.504883:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.504886:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746313.504889:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940400, rc 0) 00000100:00100000:3.0:1788746313.504938:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+51:11557:x1875636141512960:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 204us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.504945:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 202 00000100:00100000:0.0:1788746313.509267:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.511137:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141513216 00000100:00100000:1.0:1788746313.511149:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141513216 00000100:00100000:1.0:1788746313.511205:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:1.0:1788746313.511219:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+51:11557:x1875636141513216:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:1.0:1788746313.511917:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11557:x1875636141513216:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 700us (2656us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788746313.511941:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 57 00000100:00100000:0.0:1788746313.593603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.596434:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141513344 00000100:00100000:1.0:1788746313.596448:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141513344 00000100:00100000:1.0:1788746313.596513:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 203 00000100:00100000:1.0:1788746313.596524:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11567:x1875636141513344:12345-192.168.206.24@tcp:34:lfs.0 00010000:00010000:1.0:1788746313.596605:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596766:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596780:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596796:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596804:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596810:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596893:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596902:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596909:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746313.596962:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596974:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596980:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596987:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.596993:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.596997:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597004:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597015:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.597018:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.597023:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597029:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597043:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597049:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597062:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597067:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.597070:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597076:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597083:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.597085:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.597088:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597093:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597110:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597116:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597122:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597127:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.597129:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597144:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597152:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.597154:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.597158:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.597164:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.597309:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11567:x1875636141513344:12345-192.168.206.24@tcp:34:lfs.0 Request processed in 786us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.597318:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 203 00000100:00100000:0.0:1788746313.650195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.650301:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141513600 00000100:00100000:3.0:1788746313.650310:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141513600 00000100:00100000:3.0:1788746313.650373:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 204 00000100:00100000:3.0:1788746313.650382:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+52:11570:x1875636141513600:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746313.650438:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746313.650458:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b52e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650520:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650533:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650543:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650570:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650578:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650585:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650900:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a75b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650910:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.650934:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746313.650945:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788746313.651033:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651040:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651046:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651052:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746313.651055:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651062:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651073:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:3.0:1788746313.651076:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746313.651081:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651087:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a74d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651099:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651106:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651118:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651122:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746313.651126:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651132:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651139:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd44773e700) 00010000:00010000:3.0:1788746313.651141:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746313.651144:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651148:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651194:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b52e expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651206:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b52e expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.651212:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.651215:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746313.651217:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941400, rc 0) 00000100:00100000:3.0:1788746313.651278:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+54:11570:x1875636141513600:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 896us (1092us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788746313.651295:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 204 00000100:00100000:2.0:1788746313.658623:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746313.658653:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746313.658714:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746313.658878:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163523328 00000100:00100000:3.0:1788746313.658886:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163523328 00000100:00100000:3.0:1788746313.658940:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788746313.658949:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163523328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746313.658980:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746313.659033:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875636163523328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.659040:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746313.659200:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746313.659948:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.660112:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141513728 00000100:00100000:3.0:1788746313.660118:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141513728 00000100:00100000:3.0:1788746313.660161:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 205 00000100:00100000:3.0:1788746313.660170:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+54:11570:x1875636141513728:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:3.0:1788746313.660236:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660252:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660264:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660289:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660297:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660303:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660324:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746313.660329:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660336:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660348:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.660351:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746313.660356:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.660361:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.660764:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+54:11570:x1875636141513728:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 593us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.660773:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 205 00000100:00100000:0.0:1788746313.664659:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746313.664775:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141513984 00000100:00100000:2.0:1788746313.664785:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141513984 00000100:00100000:2.0:1788746313.664844:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:2.0:1788746313.664853:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+54:11570:x1875636141513984:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:2.0:1788746313.665080:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11570:x1875636141513984:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 227us (428us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788746313.665088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 58 00000100:00100000:0.0:1788746313.778525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.778733:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141514240 00000100:00100000:1.0:1788746313.778742:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141514240 00000100:00100000:1.0:1788746313.778804:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 206 00000100:00100000:1.0:1788746313.778816:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11580:x1875636141514240:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:1.0:1788746313.778840:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.778843:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788746313.778870:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a6eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b512 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.778891:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.778896:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746313.778909:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a770 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b535 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.779038:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.779051:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.779061:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746313.779072:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788746313.779323:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a770 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b535 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.779341:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b535 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.779349:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.779352:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746313.779355:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401e00, rc 0) 00000100:00100000:1.0:1788746313.779504:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11580:x1875636141514240:12345-192.168.206.24@tcp:101:bash.0 Request processed in 690us (987us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788746313.779512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 206 00000100:00100000:0.0:1788746313.785656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746313.785757:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.785951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141514368 00000100:00100000:3.0:1788746313.785961:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141514368 00000100:00100000:3.0:1788746313.786027:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:3.0:1788746313.786038:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+56:2348:x1875636141514368:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746313.786054:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746313.786089:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401e00/0xe59b64da5b30a777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b535 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.786113:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.786118:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746313.786187:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+55:2348:x1875636141514368:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 151us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.786195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:1.0:1788746313.787596:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141514624 00000100:00100000:1.0:1788746313.787606:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141514624 00000100:00100000:1.0:1788746313.787657:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 207 00000100:00100000:1.0:1788746313.787666:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+55:11580:x1875636141514624:12345-192.168.206.24@tcp:36:bash.0 00010000:00010000:1.0:1788746313.787721:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.787813:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a75b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b52e expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.787839:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.787844:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746313.788116:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.788129:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.788140:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788746313.788183:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1788746313.788349:0:8618:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000833feb14 reply state 000000006ff0005f transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.788358:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788746313.788511:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11580:x1875636141514624:12345-192.168.206.24@tcp:36:bash.0 Request processed in 845us (2862us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788746313.788518:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 207 00000020:00080000:1.0:1788746313.788523:0:8618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788746313.790741:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790757:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790765:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790772:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746313.790777:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790784:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790800:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746313.790804:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746313.790823:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746313.790829:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746313.792124:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.792262:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141514752 00000100:00100000:3.0:1788746313.792272:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141514752 00000100:00100000:3.0:1788746313.792595:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 208 00000100:00100000:3.0:1788746313.792616:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+56:11580:x1875636141514752:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:3.0:1788746313.792646:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746313.792665:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a78c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b53c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.792743:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.792756:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.792768:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746313.792796:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788746313.792800:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746313.792817:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.792840:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a78c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.794987:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.795025:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.795028:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746313.795032:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941c00, rc 0) 00000100:00100000:3.0:1788746313.795218:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11580:x1875636141514752:12345-192.168.206.24@tcp:101:bash.0 Request processed in 2612us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.795229:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 208 00000100:00100000:0.0:1788746313.802466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.805484:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515008 00000100:00100000:1.0:1788746313.805500:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515008 00000100:00100000:1.0:1788746313.805578:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:3.0:1788746313.805588:0:5852:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788746313.805589:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+57:11580:x1875636141515008:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:3.0:1788746313.805610:0:5852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788746313.805848:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11580:x1875636141515008:12345-192.168.206.24@tcp:35:bash.0 Request processed in 260us (3390us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788746313.805856:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 59 00000100:00100000:0.0:1788746313.856114:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.856219:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515136 00000100:00100000:1.0:1788746313.856234:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515136 00000100:00100000:1.0:1788746313.856329:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 209 00000100:00100000:1.0:1788746313.856340:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+58:11586:x1875636141515136:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746313.856366:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.856388:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b543 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856487:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856501:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856511:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746313.856545:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788746313.856549:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746313.856563:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856591:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b543 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856733:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b543 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.856741:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.856744:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746313.856821:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401400, rc 0) 00000100:00100000:1.0:1788746313.856908:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141515136:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 570us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.856914:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 209 00000100:00100000:0.0:1788746313.860125:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.860203:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515264 00000100:00100000:1.0:1788746313.860211:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515264 00000100:00100000:1.0:1788746313.860261:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 210 00000100:00100000:1.0:1788746313.860272:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141515264:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746313.860295:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.860316:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a7a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b54a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860371:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860381:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860389:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860451:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860457:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860462:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860539:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860561:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860568:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746313.860712:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788746313.860718:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746313.860737:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860748:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860766:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860772:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860778:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860784:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.860787:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860795:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860805:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746313.860808:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.860821:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860827:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a7af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860844:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860851:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860857:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860862:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746313.860865:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860870:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860878:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746313.860879:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746313.860882:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860885:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a7b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860910:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a7a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b54a expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860928:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b54a expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.860933:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.860935:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746313.860936:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401000, rc 0) 00000100:00100000:1.0:1788746313.861180:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11586:x1875636141515264:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 908us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.861187:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 210 00000100:00100000:0.0:1788746313.863489:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.863553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515392 00000100:00100000:1.0:1788746313.863561:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515392 00000100:00100000:0.0:1788746313.863606:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.863709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:1.0:1788746313.863720:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:2350:x1875636141515392:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746313.863734:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788746313.863745:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515648 00010000:00010000:1.0:1788746313.863756:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b54a expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.863760:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515648 00010000:00010000:1.0:1788746313.863774:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.863779:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746313.863797:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 211 00000100:00100000:3.0:1788746313.863804:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11586:x1875636141515648:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746313.863819:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788746313.863823:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:2350:x1875636141515392:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.863829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00010000:00010000:3.0:1788746313.863832:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b551 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.863908:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.863921:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.863929:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.864170:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.864202:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 60 pid: 5849 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.864215:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163523456:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746313.865098:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746313.867238:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.867667:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141515776 00000100:00100000:1.0:1788746313.867676:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141515776 00010000:00010000:1.0:1788746313.867711:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 61 pid: 5849 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746313.867764:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 76 00000100:00100000:1.0:1788746313.867775:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+61:2349:x1875636141515776:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746313.867788:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.867795:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 61 pid: 5849 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.867807:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 61 pid: 5849 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.867829:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.867834:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.867844:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.867852:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.867870:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746313.867905:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b53c expref: 61 pid: 5849 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746313.867921:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163523456:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746313.867922:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+60:2349:x1875636141515776:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 149us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.867928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 76 00010000:00010000:3.0:1788746313.867941:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.867950:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.867956:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746313.867974:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788746313.868115:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.868130:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.868137:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746313.868145:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788746313.868149:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940c00, rc 0) 00000100:00100000:3.0:1788746313.868171:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11586:x1875636141515648:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 4367us (4565us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788746313.868177:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 211 00000100:00100000:0.0:1788746313.872857:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.873082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516032 00000100:00100000:1.0:1788746313.873094:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516032 00000100:00100000:1.0:1788746313.873168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:1.0:1788746313.873179:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11586:x1875636141516032:12345-192.168.206.24@tcp:103:lfs.0 00010000:00010000:1.0:1788746313.873208:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746313.873232:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a72a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b527 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.873251:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.873255:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746313.873361:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141516032:12345-192.168.206.24@tcp:103:lfs.0 Request processed in 183us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.873369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:0.0:1788746313.876721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746313.876918:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516160 00000100:00100000:3.0:1788746313.876928:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516160 00000100:00100000:3.0:1788746313.877015:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 212 00000100:00100000:3.0:1788746313.877026:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141516160:12345-192.168.206.24@tcp:58:lfs.0 00010000:00010000:3.0:1788746313.877127:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.877148:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746313.877160:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746313.877378:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788746313.877500:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141516160:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 474us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746313.877509:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 212 00000100:00100000:0.0:1788746313.879457:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746313.879647:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516288 00000100:00100000:1.0:1788746313.879656:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516288 00000100:00100000:1.0:1788746313.879710:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 213 00000100:00100000:1.0:1788746313.879719:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+59:11586:x1875636141516288:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746313.879738:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746313.879893:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b558 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.879943:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.879954:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.880084:0:8618:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.880099:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.880135:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746313.880138:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788746313.880143:0:8618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746313.880151:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401000, rc 0) 00000100:00100000:1.0:1788746313.880201:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11586:x1875636141516288:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 483us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746313.880208:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 213 00000040:00080000:0.0:1788746314.172516:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746314.172536:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746314.172709:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788746314.172717:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746314.172845:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f529c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163523584:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746314.172932:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788746314.181979:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f529c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163523584:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746314.187261:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.188016:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516416 00000100:00100000:1.0:1788746314.188027:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516416 00000100:00100000:1.0:1788746314.188138:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 214 00000100:00100000:1.0:1788746314.188149:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11587:x1875636141516416:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788746314.188204:0:5850:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788746314.188326:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11587:x1875636141516416:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 178us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746314.188334:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 214 00000100:00100000:0.0:1788746314.195260:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.195695:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516544 00000100:00100000:3.0:1788746314.195705:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516544 00000100:00100000:3.0:1788746314.195768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 215 00000100:00100000:3.0:1788746314.195777:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11587:x1875636141516544:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.195844:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195872:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195885:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195958:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195966:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195973:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.195996:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196004:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196011:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746314.196049:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788746314.196054:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788746314.196066:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196077:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196092:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196100:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196105:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746314.196109:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196116:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196128:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:3.0:1788746314.196131:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746314.196136:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196142:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941c00/0xe59b64da5b30a7e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196156:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196163:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196169:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196174:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746314.196183:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196190:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196199:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9cd44773e700) 00010000:00010000:3.0:1788746314.196201:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746314.196204:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196210:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a7ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196232:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196238:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196244:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196249:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746314.196253:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196259:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196266:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746314.196268:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746314.196279:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.196285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a7f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.196363:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11587:x1875636141516544:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 Request processed in 587us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.196370:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 215 00000100:00100000:2.0:1788746314.199754:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.199822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516800 00000100:00100000:1.0:1788746314.199832:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516800 00000100:00100000:1.0:1788746314.199891:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 216 00000100:00100000:1.0:1788746314.199901:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+60:11587:x1875636141516800:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746314.199920:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746314.199942:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a7fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200054:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200068:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200080:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746314.200091:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788746314.200188:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200197:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200203:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200209:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746314.200213:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200220:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200244:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746314.200247:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746314.200251:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200267:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200311:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a7fc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b55f expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200321:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:1.0:1788746314.200323:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746314.200327:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a7fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b55f expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.200339:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401a00, rc 0) 00000100:00100000:1.0:1788746314.200396:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141516800:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 496us (650us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1788746314.200425:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 216 00000100:00100000:0.0:1788746314.207482:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.207637:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141516928 00000100:00100000:3.0:1788746314.207646:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141516928 00000100:00100000:3.0:1788746314.207705:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 217 00000100:00100000:3.0:1788746314.207717:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141516928:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788746314.209238:0:5851:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788746314.209473:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141516928:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 1754us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.209485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 217 00000100:00100000:0.0:1788746314.222446:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.222886:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141517184 00000100:00100000:1.0:1788746314.222895:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141517184 00000100:00100000:1.0:1788746314.222951:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 218 00000100:00100000:1.0:1788746314.222961:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141517184:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746314.222979:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746314.222983:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788746314.223007:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a7a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b543 expref: 61 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.223167:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746314.223172:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746314.223193:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a811 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b566 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746314.223590:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788746314.226228:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.226247:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.226259:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.226318:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a811 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b566 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.226341:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b566 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.226349:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746314.226352:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746314.226356:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400e00, rc 0) 00000100:00100000:1.0:1788746314.226446:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11587:x1875636141517184:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 3486us (4006us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788746314.226454:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 218 00000100:00100000:2.0:1788746314.231265:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:0.0:1788746314.234642:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746314.239035:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141517440 00000100:00100000:1.0:1788746314.239051:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141517440 00000100:00100000:1.0:1788746314.239123:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 219 00000100:00100000:1.0:1788746314.239135:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11587:x1875636141517440:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788746314.239224:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746314.239253:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400e00/0xe59b64da5b30a818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b566 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239276:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd4511ad700) 00010000:00010000:1.0:1788746314.239287:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746314.239308:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239324:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239333:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239348:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239355:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239362:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239444:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239451:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239458:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239471:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746314.239476:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239483:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239491:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:1.0:1788746314.239493:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746314.239497:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239503:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a826 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239513:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239519:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239524:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239529:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746314.239532:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239537:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239555:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb53be8d7 (ffff9cd4511adf00) 00010000:00010000:1.0:1788746314.239557:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746314.239560:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.239566:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401800/0xe59b64da5b30a82d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb53be8d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.239671:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141517440:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 537us (8415us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788746314.239680:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 219 00000100:00100000:0.0:1788746314.242491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746314.242628:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141517568 00000100:00100000:2.0:1788746314.242646:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141517568 00000100:00100000:2.0:1788746314.242697:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 220 00000100:00100000:2.0:1788746314.242709:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+61:11587:x1875636141517568:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746314.242726:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746314.242758:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a834 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b56d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242794:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242807:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242819:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242929:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242949:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.242969:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746314.242972:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746314.242976:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:2.0:1788746314.243049:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11587:x1875636141517568:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 343us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746314.243056:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 220 00000100:00100000:0.0:1788746314.255301:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.256153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141517824 00000100:00100000:3.0:1788746314.256165:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141517824 00000100:00100000:3.0:1788746314.256228:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 221 00000100:00100000:3.0:1788746314.256239:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+62:11587:x1875636141517824:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.256317:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.256334:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.256346:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746314.256672:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788746314.256684:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388661285100ns, next at 389661280723ns, rc = 0 00000004:00010000:3.0:1788746314.256793:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000745d3844 reply state 000000001d0d5b4a transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.256803:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746314.261792:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+64:11587:x1875636141517824:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 5533us (6477us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788746314.261805:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 221 00000100:00100000:0.0:1788746314.274065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.274438:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141517952 00000100:00100000:3.0:1788746314.274451:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141517952 00000100:00100000:3.0:1788746314.274512:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 222 00000100:00100000:3.0:1788746314.274523:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+64:11587:x1875636141517952:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.274545:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746314.274566:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b574 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.274654:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 65 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.274670:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 65 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.274690:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746314.274693:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788746314.274697:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f940400, rc 0) 00000100:00100000:3.0:1788746314.274775:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+65:11587:x1875636141517952:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 254us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.274782:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 222 00010000:00010000:1.0:1788746314.274906:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274915:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274921:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274927:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746314.274931:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274939:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274951:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:1.0:1788746314.274953:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746314.274966:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.274973:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a842 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.288540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.289074:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141518080 00000100:00100000:3.0:1788746314.289088:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141518080 00000100:00100000:3.0:1788746314.289169:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00100000:3.0:1788746314.289181:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd443773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2349:x1875636141518080:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788746314.289550:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd443773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2349:x1875636141518080:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 369us (1018us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788746314.289559:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00080000:0.0:1788746314.290594:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746314.293469:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.293551:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141518336 00000100:00100000:1.0:1788746314.293560:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141518336 00000100:00100000:1.0:1788746314.293617:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:1.0:1788746314.293627:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+64:11587:x1875636141518336:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788746314.293890:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+65:11587:x1875636141518336:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 263us (429us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788746314.293899:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 60 00000100:00100000:1.0:1788746314.296496:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.296583:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141518592 00000100:00100000:0.0:1788746314.296592:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141518592 00000100:00100000:0.0:1788746314.296663:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 223 00000100:00100000:0.0:1788746314.296674:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+65:11587:x1875636141518592:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788746314.296967:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+65:11587:x1875636141518592:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 294us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.296976:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 223 00000100:00100000:2.0:1788746314.307714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.309151:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141518720 00000100:00100000:0.0:1788746314.309163:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141518720 00000100:00100000:0.0:1788746314.309243:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 224 00000100:00100000:0.0:1788746314.309253:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+65:11587:x1875636141518720:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746314.309272:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746314.309293:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309361:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309375:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309384:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746314.309471:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746314.309487:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309512:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8a00/0xe59b64da5b30a850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b57b expref: 67 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309530:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b57b expref: 66 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.309538:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:0.0:1788746314.309541:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788746314.309545:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9800, rc 0) 00000100:00100000:0.0:1788746314.309600:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd476fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+66:11587:x1875636141518720:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 348us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.309617:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 224 00000100:00100000:2.0:1788746314.316170:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.316468:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141518848 00000100:00100000:1.0:1788746314.316479:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141518848 00000100:00100000:1.0:1788746314.316541:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:1.0:1788746314.316551:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+10:2350:x1875636141518848:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746314.316571:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746314.316592:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b582 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746314.316884:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1a4b, blocks: 0x1 00010000:00010000:1.0:1788746314.316908:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1788746314.316913:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746314.316923:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.316960:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.316972:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400e00, rc 0) 00000100:00100000:1.0:1788746314.317073:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+11:2350:x1875636141518848:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 522us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746314.317080:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:1.0:1788746314.328393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.328534:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519104 00000100:00100000:3.0:1788746314.328544:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519104 00000100:00100000:3.0:1788746314.328600:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 225 00000100:00100000:3.0:1788746314.328621:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+66:11587:x1875636141519104:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788746314.328726:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44626ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+66:11587:x1875636141519104:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.328734:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 225 00000100:00100000:2.0:1788746314.333494:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.333772:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519232 00000100:00100000:3.0:1788746314.333856:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519232 00000100:00100000:3.0:1788746314.333913:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:3.0:1788746314.333923:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+11:11587:x1875636141519232:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.333942:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746314.333960:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b589 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.333992:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.334016:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746314.334020:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746314.334025:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.334062:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.334076:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.334091:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875636163523712:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746314.334288:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45022e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746314.344273:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.344459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519360 00000100:00100000:0.0:1788746314.344469:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519360 00010000:00010000:0.0:1788746314.344510:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 13 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.344543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:0.0:1788746314.344553:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141519360:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746314.344569:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746314.344591:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 13 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.344764:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 13 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.344905:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746314.344910:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746314.344920:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.344930:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.345641:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.345659:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875636163523840:192.168.206.24@tcp:105: 00000100:00100000:0.0:1788746314.345735:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760c900 going to sleep for 11 seconds 00010000:00010000:3.0:1788746314.350977:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda1d54f/0xe59b64da5b30a85e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b582 expref: 13 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.351008:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875636163523712:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746314.351043:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.351058:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd45f941c00, rc 0) 00000100:00100000:3.0:1788746314.351136:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4446d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+12:11587:x1875636141519232:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 17214us (17651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.351162:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:2.0:1788746314.358836:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.358969:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519488 00000100:00100000:3.0:1788746314.358978:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519488 00002000:00100000:3.0:1788746314.359024:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9cd477b5f100 x1875636141519488/t0(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:325/0 lens 504/0 e 0 to 0 dl 1788746325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746314.359035:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5f100 with x1875636141519488 ext(0->12) 00002000:00010000:3.0:1788746314.359040:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd477b5f100 00000100:00100000:3.0:1788746314.359070:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:3.0:1788746314.359080:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+12:2349:x1875636141519488:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788746314.359566:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+14:2349:x1875636141519488:12345-192.168.206.24@tcp:4:lhsmtool_posix.0 Request processed in 485us (736us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788746314.359575:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00002000:00100000:3.0:1788746314.359582:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9cd477b5f100 x1875636141519488/t4294967320(0) o4->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:325/0 lens 504/448 e 0 to 0 dl 1788746325 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746314.359590:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd477b5f100 with x1875636141519488 ext(0->12) 00002000:00010000:3.0:1788746314.359594:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd477b5f100 00000100:00100000:0.0:1788746314.359812:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875636163523840:192.168.206.24@tcp:105: 00010000:00010000:0.0:1788746314.359848:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746314.359872:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2349:x1875636141519360:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 15321us (15610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.359881:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:1.0:1788746314.362892:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.363261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519616 00000100:00100000:0.0:1788746314.363273:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519616 00000100:00100000:0.0:1788746314.363339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 226 00000100:00100000:0.0:1788746314.363360:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+66:11587:x1875636141519616:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788746314.455163:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967486 is committed 00000001:00080000:0.0:1788746314.455200:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1788746314.455236:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:0.0:1788746314.455375:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163523968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788746314.455473:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746314.455556:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163523968 00000100:00100000:0.0:1788746314.455563:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163523968 00000100:00100000:0.0:1788746314.455606:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788746314.455615:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875636163523968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788746314.455648:0:6680:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788746314.455672:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.455693:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.455701:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788746314.455705:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788746314.455709:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.455738:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.455765:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 12 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.455791:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875636163524096:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746314.455847:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760c900 going to sleep for 11 seconds 00000004:00080000:0.0:1788746314.455876:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788746314.455890:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788746314.455905:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788746314.455914:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788746314.455948:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163524224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788746314.455977:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746314.456006:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163524224 00000100:00100000:0.0:1788746314.456011:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163524224 00000100:00100000:0.0:1788746314.456037:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746314.456043:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163524224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788746314.456055:0:6681:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788746314.456081:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e1a4a, atime: 0x6a9e1a4a, ctime: 0x6a9e1a4a, blocks: 0x1 00010000:00010000:0.0:1788746314.456087:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456097:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788746314.456100:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746314.456105:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456120:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456144:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456151:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456168:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788746314.456718:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163524224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 674us (739us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788746314.456727:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1788746314.456749:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746314.456755:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456764:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746314.456768:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456777:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456794:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30a873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.456826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746314.456828:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746314.456830:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788746314.456861:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45f4e2680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788746314.456866:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163524224:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788746314.456910:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788746314.456936:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd47764a9c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788746314.456940:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4462e5500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd47764a540 00000020:00080000:0.0:1788746314.456943:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4462e5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd47d741800 00000020:00080000:0.0:1788746314.456985:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd477dcc3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788746314.456988:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4462e5200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd477dcca80 00000020:00080000:0.0:1788746314.456991:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd4462e5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd480286c00 00000020:00080000:0.0:1788746314.457006:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788746314.457122:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788746314.457180:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163524352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788746314.457210:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746314.457242:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163524352 00000100:00100000:0.0:1788746314.457247:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163524352 00000100:00100000:0.0:1788746314.457275:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788746314.457282:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163524352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788746314.457390:0:8456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788746314.457394:0:8456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788746315 00002000:00010000:0.0:1788746314.457432:0:8456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788746314.457441:0:8456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788746315 -> 1788746315 00002000:00010000:0.0:1788746314.457443:0:8456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788746314.457474:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1875636163524352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (263us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788746314.457481:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788746314.457512:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45f4e3800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788746314.457516:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163524352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788746314.457837:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd446268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11587:x1875636141519616:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 Request processed in 94477us (94956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.457846:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 226 00000100:00100000:1.0:1788746314.463516:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.463596:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.463640:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519872 00000100:00100000:1.0:1788746314.463649:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519872 00010000:00010000:1.0:1788746314.463689:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.463724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:1.0:1788746314.463735:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd461dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2350:x1875636141519872:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746314.464379:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746314.464389:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.464435:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.464480:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746314.464485:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746314.464491:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.464501:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.464524:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746314.464578:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd461dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2350:x1875636141519872:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 844us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746314.464586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:3.0:1788746314.464919:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141519744 00000100:00100000:3.0:1788746314.464929:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141519744 00000100:00100000:3.0:1788746314.464971:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:3.0:1788746314.464979:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+13:2350:x1875636141519744:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788746314.476108:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089dea997/0xe59b64da5b30a62e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4e8 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.476137:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875636163524096:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746314.476176:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.476189:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.476197:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.476245:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.476253:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.476276:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788746314.477088:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875636163523968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21472us (21612us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788746314.477098:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788746314.477140:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746314.477147:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.477157:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746314.477161:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.477171:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.477192:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.477200:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a98d1bd6/0xe59b64da5b30a86c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.477289:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746314.477291:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746314.477293:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788746314.493980:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd47d0f3800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788746314.493995:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163523968:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788746314.565319:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788746314.565335:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788746314.565351:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788746314.566139:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141519744:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 Request processed in 101154us (102626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.566152:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:1.0:1788746314.569963:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.570126:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520128 00000100:00100000:3.0:1788746314.570135:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520128 00000100:00100000:3.0:1788746314.570188:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 227 00000100:00100000:3.0:1788746314.570198:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11587:x1875636141520128:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.570244:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746314.570270:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9800/0xe59b64da5b30a857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b57b expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.570290:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746314.570295:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746314.570323:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.570335:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.570344:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746314.572451:0:5851:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000aa08a4bc reply state 000000003b5f79a5 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.572467:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746314.572567:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:11587:x1875636141520128:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 2368us (2609us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788746314.572590:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 227 00000100:00100000:1.0:1788746314.577085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.577184:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520256 00000100:00100000:0.0:1788746314.577195:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520256 00000100:00100000:0.0:1788746314.577247:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:0.0:1788746314.577257:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141520256:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788746314.577474:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788746314.577478:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788746315 -> 1788746314 00002000:00010000:0.0:1788746314.577480:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788746314 00002000:00010000:0.0:1788746314.577483:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788746315 -> 1788746314 00002000:00010000:0.0:1788746314.577485:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788746314.577545:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141520256:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 289us (467us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788746314.577554:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 69 00010000:00010000:3.0:1788746314.578490:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578503:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578511:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578517:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746314.578522:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578530:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578545:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746314.578548:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746314.578553:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.578560:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941400/0xe59b64da5b30a87a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.581191:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.581369:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520512 00000100:00100000:3.0:1788746314.581378:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520512 00000100:00100000:3.0:1788746314.581440:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 228 00000100:00100000:3.0:1788746314.581450:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:11587:x1875636141520512:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.581518:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.581549:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.581559:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.581591:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.581615:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 20 pid: 5850 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.581638:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163524480:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746314.581723:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746314.593488:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.593710:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520640 00000100:00100000:1.0:1788746314.593719:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520640 00010000:00010000:1.0:1788746314.593768:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 21 pid: 5850 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.593927:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:1.0:1788746314.593937:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:2350:x1875636141520640:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746314.593951:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746314.593957:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 21 pid: 5850 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.593971:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 21 pid: 5850 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.593990:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:1.0:1788746314.593995:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.594030:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.594037:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.594054:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746314.594102:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:2350:x1875636141520640:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 167us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746314.594109:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 79 00010000:00010000:3.0:1788746314.594915:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45200/0xe59b64da5b30a83b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b56d expref: 20 pid: 5850 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.594935:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875636163524480:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746314.594957:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.594966:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.594971:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.594998:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595014:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595020:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595026:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746314.595030:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595036:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595045:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746314.595048:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788746314.595051:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.595056:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a881 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.595127:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11587:x1875636141520512:12345-192.168.206.24@tcp:55:lhsmtool_posix.0 Request processed in 13677us (13945us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788746314.595136:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 228 00000100:00100000:2.0:1788746314.601706:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.601881:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520768 00000100:00100000:3.0:1788746314.601891:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520768 00000100:00100000:3.0:1788746314.601947:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:3.0:1788746314.601957:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141520768:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788746314.602000:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.602047:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.602055:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788746314.602059:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746314.602063:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.602099:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.602114:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 8 pid: 6682 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.602129:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163524608:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746314.602194:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47764a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788746314.611964:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8456:1875636163524608:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746314.611994:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.615063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.615427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141520896 00000100:00100000:3.0:1788746314.615437:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141520896 00010000:00010000:3.0:1788746314.615476:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 9 pid: 6682 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.615530:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:3.0:1788746314.615539:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+9:2350:x1875636141520896:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746314.615774:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746314.615863:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 9 pid: 6682 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.615879:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 9 pid: 6682 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.615901:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e35c2e/0xe59b64da5b30a865 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b589 expref: 9 pid: 6682 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.615917:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746314.615921:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788746314.615926:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.615935:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.616017:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746314.616073:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141520896:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 535us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.616081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 80 00010000:00010000:1.0:1788746314.625535:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625565:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625677:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625685:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625693:0:8456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625700:0:8456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746314.625720:0:8456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625730:0:8456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625815:0:8456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.625825:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30a888 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.625918:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141520768:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 Request processed in 23958us (24215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746314.625927:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 70 00000100:00100000:1.0:1788746314.633644:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.633768:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141521152 00000100:00100000:0.0:1788746314.633779:0:8618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141521152 00000100:00100000:0.0:1788746314.633834:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 229 00000100:00100000:0.0:1788746314.633844:0:8618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11587:x1875636141521152:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788746314.633918:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.633952:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.633966:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.634165:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.634176:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.634185:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.634215:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.634240:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 20 pid: 5850 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.634253:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163524736:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746314.634322:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4454bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746314.637448:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163524736:192.168.206.24@tcp:104: 00010000:00010000:1.0:1788746314.637491:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746314.637898:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746314.638581:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141521280 00000100:00100000:3.0:1788746314.638591:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141521280 00010000:00010000:3.0:1788746314.638643:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 21 pid: 5850 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746314.638685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 81 00000100:00100000:3.0:1788746314.638694:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+21:2350:x1875636141521280:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746314.638709:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746314.638716:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 21 pid: 5850 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638728:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 21 pid: 5850 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638761:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940400/0xe59b64da5b30a849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b574 expref: 21 pid: 5850 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638777:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:3.0:1788746314.638783:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638793:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638801:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746314.638823:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746314.638879:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+20:2350:x1875636141521280:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 185us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746314.638901:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 81 00010000:00010000:0.0:1788746314.639913:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.639924:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746314.640131:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788746314.640489:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788746314.640540:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788746314.641908:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8618:1875636163524864:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788746314.641975:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746314.642117:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746314.642171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163524864 00000100:00100000:0.0:1788746314.642179:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163524864 00000100:00100000:0.0:1788746314.642261:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746314.642272:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8618:x1875636163524864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788746314.642355:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8618:x1875636163524864:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.642363:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746314.642431:0:8618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788746314.642436:0:8618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788746314.642454:0:8618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45f4e3800, transno 4294967321 00000100:00100000:1.0:1788746314.642491:0:8618:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cd47d0f3800 x1875636163523968/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788746330 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746314.642503:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8618:1875636163524864:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788746314.642975:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788746314.643044:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8618:1875636163524992:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788746314.643076:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746314.645844:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163524992 00000100:00100000:3.0:1788746314.645857:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163524992 00000100:00100000:1.0:1788746314.646373:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788746314.646957:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746314.646967:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8618:x1875636163524992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788746314.647250:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8618:x1875636163524992:12345-0@lo:1000:mdt00_003.0 Request processed in 283us (4171us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788746314.647258:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746314.647651:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8618:1875636163524992:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788746314.647693:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647704:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647711:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647717:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746314.647722:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647738:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647753:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746314.647756:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746314.647762:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647767:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a896 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647895:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647902:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647909:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647914:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746314.647917:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647923:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647932:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746314.647934:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746314.647941:0:8618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647963:0:8618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.647971:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.648005:0:8618:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746314.648018:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163525120:192.168.206.24@tcp:105: 00000100:00100000:2.0:1788746314.648129:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477dcc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746314.651637:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8618:1875636163525120:192.168.206.24@tcp:105: 00010000:00010000:2.0:1788746314.651669:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651681:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940e00/0xe59b64da5b30a7d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651716:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651732:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651756:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651767:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651788:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651795:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651801:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746314.651805:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651813:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651826:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746314.651829:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746314.651833:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651838:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30a89d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651850:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651856:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651863:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651868:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746314.651876:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651883:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651891:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746314.651893:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746314.651896:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.651902:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a88f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746314.652144:0:8618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11587:x1875636141521152:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 18298us (18513us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788746314.652155:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 229 00000020:00080000:2.0:1788746314.652161:0:8618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788746314.652461:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746314.652466:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746314.652975:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788746314.652985:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746314.655054:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746314.655185:0:12463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141521408 00000100:00100000:2.0:1788746314.655195:0:12463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141521408 00000100:00100000:2.0:1788746314.655252:0:12463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:2.0:1788746314.655262:0:12463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11586:x1875636141521408:12345-192.168.206.24@tcp:49:lfs.0 00000100:00100000:2.0:1788746314.655417:0:12463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11586:x1875636141521408:12345-192.168.206.24@tcp:49:lfs.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746314.655426:0:12463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 61 00000100:00100000:1.0:1788746314.658041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.658194:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141521664 00000100:00100000:0.0:1788746314.658205:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141521664 00000100:00100000:0.0:1788746314.658270:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 62 00000100:00100000:0.0:1788746314.658280:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450ced450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+23:11587:x1875636141521664:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788746314.658985:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788746314.659109:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1788746314.659159:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659176:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659188:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659196:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659214:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659220:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.659232:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788746314.659327:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450ced450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+25:11587:x1875636141521664:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1292us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788746314.659335:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 62 00000020:00080000:0.0:1788746314.659341:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746314.660334:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746314.660344:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.660353:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746314.660357:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.660365:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.660380:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cd444412200) 00010000:00010000:1.0:1788746314.660383:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788746314.660387:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.660393:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746314.660431:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746314.660433:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746314.660435:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746314.663661:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.663946:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141521920 00000100:00100000:0.0:1788746314.663956:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141521920 00000100:00100000:0.0:1788746314.664019:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 230 00000100:00100000:0.0:1788746314.664029:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+25:11586:x1875636141521920:12345-192.168.206.24@tcp:58:lfs.0 00000040:00080000:0.0:1788746314.664274:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788746314.664636:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+25:11586:x1875636141521920:12345-192.168.206.24@tcp:58:lfs.0 Request processed in 597us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.664645:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 230 00000100:00100000:3.0:1788746314.699984:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746314.700142:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522048 00000100:00100000:0.0:1788746314.700151:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522048 00000100:00100000:0.0:1788746314.700205:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 231 00000100:00100000:0.0:1788746314.700215:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+25:11589:x1875636141522048:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746314.700246:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746314.700269:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b590 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700350:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700365:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700377:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700390:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700430:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700439:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700685:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700696:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700704:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700735:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.700760:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 26 pid: 5851 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.700773:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163525248:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746314.700865:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746314.704116:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f7c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875636163525248:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746314.704155:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746314.705210:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746314.705528:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522304 00000100:00100000:1.0:1788746314.705540:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522304 00000100:00100000:1.0:1788746314.705596:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:1.0:1788746314.705616:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+27:5587:x1875636141522304:12345-192.168.206.24@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788746314.706960:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+28:5587:x1875636141522304:12345-192.168.206.24@tcp:35:ldlm_bl.0 Request processed in 1340us (1747us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788746314.706971:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 63 00000100:00100000:1.0:1788746314.709282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746314.709544:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522432 00000100:00100000:2.0:1788746314.709554:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522432 00010000:00010000:2.0:1788746314.709590:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 28 pid: 5851 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746314.709773:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:2.0:1788746314.709784:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+28:2350:x1875636141522432:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746314.709800:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746314.709808:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 28 pid: 5851 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709821:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 28 pid: 5851 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709842:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940c00/0xe59b64da5b30a7cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b551 expref: 28 pid: 5851 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709859:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746314.709864:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709874:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709882:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746314.709917:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746314.709975:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+27:2350:x1875636141522432:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 193us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746314.709982:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 82 00010000:00010000:0.0:1788746314.710152:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.710161:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746314.710202:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788746314.710207:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746314.710224:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711266:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711277:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711284:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711303:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711309:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746314.711313:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711320:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711331:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:0.0:1788746314.711334:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746314.711338:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711344:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9e00/0xe59b64da5b30a8b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711358:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711365:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711370:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711375:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746314.711378:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711395:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711442:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cd444412c00) 00010000:00010000:0.0:1788746314.711444:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746314.711448:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711454:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9a00/0xe59b64da5b30a8b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711496:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30a8ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b590 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711509:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b590 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746314.711515:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:0.0:1788746314.711517:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788746314.711520:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8000, rc 0) 00000100:00100000:0.0:1788746314.711572:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11589:x1875636141522048:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 11358us (11596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746314.711581:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 231 00010000:00010000:0.0:1788746315.260150:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746315.293751:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.293796:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.293824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.293851:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.293876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.293901:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141523072 00000100:00100000:3.0:1788746315.293910:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141523072 00000100:00100000:1.0:1788746315.293915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522560 00000100:00100000:1.0:1788746315.293919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522560 00000100:00100000:3.0:1788746315.293957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 155 00000100:00100000:1.0:1788746315.293957:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 297 00000100:00100000:3.0:1788746315.293966:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2350:x1875636141523072:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746315.293966:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141522560:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746315.294025:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2350:x1875636141522560:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746315.294032:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522816 00000100:00100000:1.0:1788746315.294033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 297 00000100:00100000:0.0:1788746315.294036:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522816 00000100:00100000:0.0:1788746315.294063:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522944 00000100:00100000:1.0:1788746315.294065:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:0.0:1788746315.294066:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522944 00000100:00100000:1.0:1788746315.294072:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141522816:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746315.294098:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:0.0:1788746315.294261:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141522944:12345-192.168.206.24@tcp:400:kworker.0 00000100:00080000:2.0:1788746315.297567:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746315.297593:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746315.297614:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141522688 00000100:00100000:2.0:1788746315.297633:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141522688 00000100:00100000:3.0:1788746315.299523:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2350:x1875636141523072:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 282us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746315.299606:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141522944:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 187us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746315.299618:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:2.0:1788746315.299712:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 156 00000100:00100000:2.0:1788746315.299732:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:2350:x1875636141522688:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746315.299818:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+26:2350:x1875636141522688:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 95us (5966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746315.301696:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2350:x1875636141522816:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 7613us (7888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746315.301710:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:3.0:1788746315.303433:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 155 00000100:00080000:3.0:1788746315.304525:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746315.306887:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 156 00000040:00080000:2.0:1788746315.636229:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788746315.636237:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746315.636275:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788746315.636281:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788746315.713825:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746315.713834:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746315.713883:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788746315.713889:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746315.714027:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d291c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163525376:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746315.714109:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47760c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788746315.722539:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.722567:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141523200 00000100:00100000:3.0:1788746315.722575:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141523200 00000100:00100000:0.0:1788746315.722612:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d291c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875636163525376:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788746315.722641:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 232 00000100:00100000:3.0:1788746315.722650:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11602:x1875636141523200:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788746315.722679:0:5850:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788746315.723392:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4802a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11602:x1875636141523200:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 740us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746315.723431:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 232 00000100:00100000:0.0:1788746315.736376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746315.736634:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141523456 00000100:00100000:1.0:1788746315.736644:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141523456 00000100:00100000:1.0:1788746315.736696:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 233 00000100:00100000:1.0:1788746315.736707:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+26:11602:x1875636141523456:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746315.736728:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746315.736760:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a8c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b597 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.736853:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a8ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.736867:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a8ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.736882:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a8ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746315.736893:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788746315.737013:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400600/0xe59b64da5b30a8c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b597 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.737031:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a8ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b597 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.737039:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746315.737042:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746315.737046:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400400, rc 0) 00000100:00100000:1.0:1788746315.737113:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+28:11602:x1875636141523456:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 408us (744us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788746315.737120:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 233 00000100:00100000:0.0:1788746315.746243:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746315.746350:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141523712 00000100:00100000:3.0:1788746315.746360:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141523712 00000100:00100000:3.0:1788746315.746441:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 234 00000100:00100000:3.0:1788746315.746451:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+28:11602:x1875636141523712:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788746315.746527:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746543:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746553:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746741:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746749:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746755:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746773:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746315.746777:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746783:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746794:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746315.746797:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746315.746801:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746315.746807:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746315.746941:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+29:11602:x1875636141523712:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 490us (704us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788746315.746949:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 234 00000040:00080000:1.0:1788746315.747164:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788746315.747169:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788746315.747695:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788746315.747706:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788746315.754209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746315.754264:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746315.754347:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141523840 00000100:00100000:1.0:1788746315.754369:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141523840 00000100:00100000:1.0:1788746315.754478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746315.754489:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+29:2347:x1875636141523840:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746315.754504:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746315.754528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477400400/0xe59b64da5b30a8ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b597 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746315.754548:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:1.0:1788746315.754554:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746315.754615:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+28:2347:x1875636141523840:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746315.754633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:3.0:1788746315.754876:0:12463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524096 00000100:00100000:3.0:1788746315.754882:0:12463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524096 00000100:00100000:3.0:1788746315.754919:0:12463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:3.0:1788746315.754927:0:12463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+28:11602:x1875636141524096:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746315.755114:0:12463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+29:11602:x1875636141524096:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 187us (911us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788746315.755121:0:12463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 64 00000100:00100000:0.0:1788746316.218872:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163525504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746316.218943:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746316.219084:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163525504 00000100:00100000:3.0:1788746316.219092:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163525504 00000100:00100000:3.0:1788746316.219168:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746316.219177:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163525504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746316.219210:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746316.219256:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163525504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746316.219263:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788746316.219364:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746316.219443:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163525504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788746316.282808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746317.313293:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788746317.678830:0:12552:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746317.678838:0:12552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746317.678883:0:12552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788746317.678889:0:12552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788746317.888574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746317.888633:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524352 00000100:00100000:3.0:1788746317.888641:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524352 00000100:00100000:3.0:1788746317.888698:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 235 00000100:00100000:3.0:1788746317.888707:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+29:11622:x1875636141524352:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746317.888728:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746317.888746:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b59e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746317.888836:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30a8ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746317.888851:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30a8ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746317.888864:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30a8ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746317.888875:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788746317.888996:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030000/0xe59b64da5b30a8e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b59e expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746317.889016:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30a8ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b59e expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746317.889034:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:3.0:1788746317.889037:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788746317.889041:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440030e00, rc 0) 00000100:00100000:3.0:1788746317.889093:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11622:x1875636141524352:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 387us (526us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788746317.889100:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 235 00000100:00080000:3.0:1788746317.893635:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746317.905885:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746317.905929:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524480 00000100:00100000:0.0:1788746317.905945:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524480 00000100:00100000:0.0:1788746317.905999:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 236 00000100:00100000:0.0:1788746317.906010:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11622:x1875636141524480:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:0.0:1788746317.906329:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906346:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906358:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906382:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906389:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906464:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906471:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746317.906475:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906482:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906493:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:0.0:1788746317.906496:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746317.906501:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746317.906518:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9400/0xe59b64da5b30a8f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746317.906691:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+31:11622:x1875636141524480:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 682us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746317.906699:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 236 00000100:00100000:3.0:1788746318.030526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746318.030747:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524608 00000100:00100000:1.0:1788746318.030758:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524608 00000100:00100000:1.0:1788746318.030845:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 71 00000100:00100000:1.0:1788746318.030856:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141524608:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:1.0:1788746318.030872:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746318.030894:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30a8ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5a5 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746318.030918:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e1a4a, atime: 0x6a9e1a4a, ctime: 0x6a9e1a4a, blocks: 0xb 00010000:00010000:1.0:1788746318.030940:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1788746318.030945:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746318.030954:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30a8ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5a5 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746318.030993:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30a8ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5a5 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746318.031006:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400800, rc 0) 00000100:00100000:1.0:1788746318.031076:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2349:x1875636141524608:12345-192.168.206.24@tcp:101:cat.0 Request processed in 222us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746318.031083:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 71 00000100:00080000:3.0:1788746318.031645:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746318.034757:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746318.034952:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524736 00000100:00100000:3.0:1788746318.034960:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524736 00002000:00100000:3.0:1788746318.035004:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9cd45f784a80 x1875636141524736/t0(0) o3->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:329/0 lens 488/0 e 0 to 0 dl 1788746329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746318.035015:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f784a80 with x1875636141524736 ext(0->4095) 00002000:00010000:3.0:1788746318.035021:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f784a80 00000100:00100000:3.0:1788746318.035159:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:3.0:1788746318.035169:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141524736:12345-192.168.206.24@tcp:3:cat.0 00000100:00100000:3.0:1788746318.035389:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+8:2350:x1875636141524736:12345-192.168.206.24@tcp:3:cat.0 Request processed in 220us (639us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788746318.035435:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00002000:00100000:3.0:1788746318.035443:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9cd45f784a80 x1875636141524736/t0(0) o3->783b9179-e60a-4972-9e46-67c8ee44ca13@192.168.206.24@tcp:329/0 lens 488/4536 e 0 to 0 dl 1788746329 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788746318.035451:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9cd45f784a80 with x1875636141524736 ext(0->4095) 00002000:00010000:3.0:1788746318.035455:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cd45f784a80 00000100:00100000:0.0:1788746318.269143:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746318.269164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163525632:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.269228:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746318.269338:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163525632 00000100:00100000:0.0:1788746318.269346:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163525632 00000100:00100000:0.0:1788746318.269389:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788746318.269427:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163525632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.269473:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3315:x1875636163525632:12345-0@lo:400:kworker.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746318.269480:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788746318.269524:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163525632:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.269567:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163525760:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.272022:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746318.272114:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746318.272329:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746318.272340:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163526016:0@lo:400:kworker.0 00000100:00100000:1.0:1788746318.272381:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746318.272431:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526016 00000100:00100000:1.0:1788746318.272438:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526016 00000100:00100000:1.0:1788746318.272491:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788746318.272500:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746318.272546:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875636163526016:12345-0@lo:400:kworker.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746318.272553:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788746318.272574:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746318.273543:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.273701:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163525888:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.273747:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746318.273783:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163525760 00000100:00100000:0.0:1788746318.273788:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163525760 00000100:00100000:0.0:1788746318.273829:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788746318.273837:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163525760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.273880:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875636163525760:12345-0@lo:400:kworker.0 Request processed in 44us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746318.273886:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788746318.273900:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163525888 00000100:00100000:0.0:1788746318.273903:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163525888 00000100:00100000:0.0:1788746318.273936:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788746318.273941:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163525888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.273972:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163525888:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746318.273977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788746318.274003:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163525888:0@lo:400:kworker.0 00000100:00100000:0.0:1788746318.274027:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875636163525760:0@lo:400:kworker.0 00000100:00080000:0.0:1788746318.274066:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746318.274157:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746318.274167:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788746318.274193:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746318.274214:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526144 00000100:00100000:1.0:1788746318.274218:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526144 00000100:00100000:1.0:1788746318.274253:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788746318.274259:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163526144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788746318.274468:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746318.275590:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163526272:0@lo:400:kworker.0 00000100:00100000:2.0:1788746318.275654:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746318.275700:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526272 00000100:00100000:2.0:1788746318.275706:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526272 00000100:00100000:2.0:1788746318.275750:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788746318.275757:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163526272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746318.275796:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163526272:12345-0@lo:400:kworker.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746318.275803:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788746318.275830:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746318.275853:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163526272:0@lo:400:kworker.0 00000100:00100000:2.0:1788746318.276624:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788746318.276673:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163526144:12345-0@lo:400:kworker.0 Request processed in 1965us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746318.276684:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:1.0:1788746318.331223:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746318.342941:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788746318.342960:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788746318.778692:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746318.778715:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163526400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746318.778779:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746318.778834:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526400 00000100:00100000:3.0:1788746318.778842:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526400 00000100:00100000:3.0:1788746318.778890:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746318.778900:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163526400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746318.778933:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788746318.778990:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163526400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746318.778996:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746318.779135:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163526400:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746319.355524:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746319.895841:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:0.0:1788746319.895863:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1788746319.895875:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1788746319.895883:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cd44512ba80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788746319.895887:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd47ff64900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cd44512be40 00000020:00080000:0.0:1788746319.895891:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cd47ff64400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cd45f658000 00000001:00080000:0.0:1788746319.895910:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788746319.896546:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788746319.896726:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788746319.910179:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788746319.910195:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788746319.910213:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1788746320.378791:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746320.411098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746320.411139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746320.411171:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746320.411205:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746320.411226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746320.411259:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525120 00000100:00100000:0.0:1788746320.411267:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525120 00000100:00100000:0.0:1788746320.411317:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525248 00000100:00100000:0.0:1788746320.411321:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525248 00000100:00100000:0.0:1788746320.411341:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:0.0:1788746320.411350:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141525120:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746320.411440:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2348:x1875636141525120:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746320.411448:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:0.0:1788746320.411465:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:0.0:1788746320.411472:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2348:x1875636141525248:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746320.411499:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2348:x1875636141525248:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746320.411504:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:3.0:1788746320.411669:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524864 00000100:00100000:3.0:1788746320.411674:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524864 00000100:00100000:3.0:1788746320.411702:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 299 00000100:00100000:3.0:1788746320.411709:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141524864:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746320.411745:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2348:x1875636141524864:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746320.411750:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 299 00000100:00100000:3.0:1788746320.411774:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525376 00000100:00100000:3.0:1788746320.411777:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525376 00000100:00100000:3.0:1788746320.411810:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141524992 00000100:00100000:3.0:1788746320.411814:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141524992 00000100:00100000:3.0:1788746320.411833:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 160 00000100:00100000:3.0:1788746320.411839:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141525376:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746320.411866:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2348:x1875636141525376:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746320.411873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 160 00000100:00100000:3.0:1788746320.411884:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 161 00000100:00100000:3.0:1788746320.411890:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2348:x1875636141524992:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746320.411927:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2348:x1875636141524992:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 37us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746320.411934:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 161 00000100:00080000:2.0:1788746320.412142:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788746320.412147:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746320.412149:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788746320.890685:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788746320.890693:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746320.890742:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788746320.890749:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788746321.341128:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746321.341195:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746321.341299:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526528 00000100:00100000:3.0:1788746321.341307:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526528 00000100:00100000:3.0:1788746321.341364:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746321.341373:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746321.341427:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788746321.341499:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746321.349382:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8001us (8177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746321.349428:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788746321.352440:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788746321.352453:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788746321.352477:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45f4e2680, transno 4294967310 00000100:00100000:1.0:1788746321.352559:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163526528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788746321.402628:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746322.427754:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746323.390177:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163526656:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390253:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163527168:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390319:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390342:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788746323.390348:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163526784:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390366:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390381:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163527296:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390420:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390447:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163526912:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390469:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390487:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746323.390493:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163527040:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.390539:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526656 00000100:00100000:0.0:1788746323.390546:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526656 00000100:00100000:0.0:1788746323.390596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788746323.390605:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163526656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390658:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163526656:12345-0@lo:400:kworker.0 Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746323.390664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788746323.390691:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527168 00000100:00100000:0.0:1788746323.390694:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527168 00000100:00100000:0.0:1788746323.390723:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526784 00000100:00100000:0.0:1788746323.390726:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526784 00000100:00100000:0.0:1788746323.390736:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163526912 00000100:00100000:0.0:1788746323.390738:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163526912 00000100:00100000:0.0:1788746323.390762:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788746323.390767:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163527168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390799:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163527168:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746323.390804:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788746323.390816:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788746323.390821:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163526784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390846:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163526784:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746323.390852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788746323.390864:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788746323.390870:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163526912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390898:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163526912:12345-0@lo:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746323.390903:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788746323.390921:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527296 00000100:00100000:0.0:1788746323.390924:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527296 00000100:00100000:0.0:1788746323.390948:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527040 00000100:00100000:0.0:1788746323.390950:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527040 00000100:00100000:0.0:1788746323.390966:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788746323.390971:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163527296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.390998:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163527296:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746323.399482:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788746323.399509:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163527040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.399619:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163527040:12345-0@lo:400:kworker.0 Request processed in 124us (9104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746323.399627:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788746323.401828:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746323.401838:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746323.401841:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746323.401900:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.401916:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163526912:0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.401958:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163526784:0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.401968:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788746323.401972:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd47d0f3800, transno 4294967322 00000004:00080000:2.0:1788746323.401994:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788746323.402014:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163527296:0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.402025:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163526656:0@lo:400:kworker.0 00000100:00100000:2.0:1788746323.402035:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163527168:0@lo:400:kworker.0 00000100:00100000:0.0:1788746323.405300:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:1.0:1788746323.466070:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746323.899429:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746323.913864:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746323.913957:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746323.914250:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527424 00000100:00100000:0.0:1788746323.914261:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527424 00000100:00100000:0.0:1788746323.914320:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788746323.914343:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163527424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746323.914377:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746323.914472:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163527424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746323.914480:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788746323.914661:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746324.097880:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746324.099295:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525504 00000100:00100000:0.0:1788746324.099306:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525504 00000100:00100000:0.0:1788746324.099372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 237 00000100:00100000:0.0:1788746324.099385:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11275:x1875636141525504:12345-192.168.206.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788746324.099516:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11275:x1875636141525504:12345-192.168.206.24@tcp:60:lhsmtool_posix.0 Request processed in 134us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746324.099524:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 237 00000100:00080000:2.0:1788746324.099775:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746324.102935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746324.103017:0:12463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525760 00000100:00100000:3.0:1788746324.103027:0:12463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525760 00000100:00100000:3.0:1788746324.103087:0:12463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 65 00000100:00100000:3.0:1788746324.103096:0:12463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:11275:x1875636141525760:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788746324.103461:0:12463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:11275:x1875636141525760:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 364us (534us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788746324.103468:0:12463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 65 00010000:00010000:0.0:1788746324.474700:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788746324.979817:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788746324.979845:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788746324.980078:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788746324.980090:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788746325.498808:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746325.527307:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746325.527346:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746325.527376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746325.527454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746325.527483:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746325.527566:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526144 00000100:00100000:2.0:1788746325.527591:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526144 00000100:00100000:2.0:1788746325.527654:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526272 00000100:00100000:2.0:1788746325.527657:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526272 00000100:00100000:2.0:1788746325.527679:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:2.0:1788746325.527700:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141526144:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746325.527769:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2347:x1875636141526144:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746325.527776:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:2.0:1788746325.527810:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:2.0:1788746325.527828:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141526272:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746325.527855:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2347:x1875636141526272:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746325.527862:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:3.0:1788746325.528173:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141525888 00000100:00100000:3.0:1788746325.528179:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141525888 00000100:00100000:3.0:1788746325.528218:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 301 00000100:00100000:3.0:1788746325.528226:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141525888:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:3.0:1788746325.528253:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2347:x1875636141525888:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 28us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746325.528260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 301 00000100:00080000:0.0:1788746325.529099:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746325.529106:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746325.529967:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526400 00000100:00100000:1.0:1788746325.529980:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526400 00000100:00100000:1.0:1788746325.530056:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526016 00000100:00100000:1.0:1788746325.530075:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526016 00000100:00100000:1.0:1788746325.530115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 165 00000100:00100000:1.0:1788746325.530124:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141526400:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746325.530191:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2347:x1875636141526400:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 68us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746325.530198:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 165 00000100:00100000:1.0:1788746325.530214:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 166 00000100:00100000:1.0:1788746325.530226:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2347:x1875636141526016:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746325.530258:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2347:x1875636141526016:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 37us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746325.530264:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 166 00000100:00080000:0.0:1788746325.532175:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746326.459769:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163527552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746326.459833:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746326.460007:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527552 00000100:00100000:2.0:1788746326.460016:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527552 00000100:00100000:2.0:1788746326.460082:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788746326.460092:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163527552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746326.460124:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746326.460171:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163527552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746326.460178:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788746326.460240:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163527552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788746326.460843:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788746326.523678:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788746326.589818:0:12754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:58:45 (1788746325) 00010000:00010000:3.0:1788746327.549354:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746328.508421:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746328.510495:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163527680:0@lo:400:kworker.0 00000100:00100000:3.0:1788746328.510884:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746328.510947:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746328.510955:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163527808:0@lo:400:kworker.0 00000100:00100000:3.0:1788746328.510985:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746328.511019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527680 00000100:00100000:3.0:1788746328.511027:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527680 00000100:00100000:3.0:1788746328.511069:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788746328.511078:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163527680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746328.511127:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163527680:12345-0@lo:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746328.511133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788746328.511179:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163527680:0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.513913:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527808 00000100:00100000:1.0:1788746328.513925:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527808 00000100:00100000:1.0:1788746328.514076:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788746328.514086:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163527808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.514167:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163527808:12345-0@lo:400:kworker.0 Request processed in 82us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746328.514174:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788746328.516019:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163528320:0@lo:400:kworker.0 00000100:00100000:2.0:1788746328.516074:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746328.516106:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788746328.516119:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163528192:0@lo:400:kworker.0 00000100:00100000:2.0:1788746328.516144:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746328.524471:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528320 00000100:00100000:3.0:1788746328.524483:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528320 00000100:00100000:3.0:1788746328.524635:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788746328.524645:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746328.524910:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163528320:12345-0@lo:400:kworker.0 Request processed in 267us (8834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746328.524918:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788746328.527575:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163528320:0@lo:400:kworker.0 00000100:00080000:2.0:1788746328.528599:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746328.528635:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163527808:0@lo:400:kworker.0 00000100:00100000:0.0:1788746328.529833:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528192 00000100:00100000:0.0:1788746328.529844:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528192 00000100:00100000:1.0:1788746328.532783:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.532848:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746328.532896:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163527936:0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.532927:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746328.533202:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528064 00000100:00100000:2.0:1788746328.533209:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528064 00000100:00100000:2.0:1788746328.533263:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788746328.533272:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163528064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746328.533319:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163528064:12345-0@lo:400:kworker.0 Request processed in 48us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746328.533325:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788746328.533351:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746328.533639:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.534490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163527936 00000100:00100000:1.0:1788746328.534497:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163527936 00000100:00100000:1.0:1788746328.534518:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788746328.534525:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163528192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.534582:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163528192:12345-0@lo:400:kworker.0 Request processed in 57us (18437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746328.534590:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788746328.534602:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788746328.534607:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163527936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746328.534632:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163527936:12345-0@lo:400:kworker.0 Request processed in 26us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746328.534638:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788746328.534663:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163527936:0@lo:400:kworker.0 00000100:00080000:2.0:1788746328.536696:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746328.536747:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163528192:0@lo:400:kworker.0 00010000:00010000:0.0:1788746328.570669:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746329.019631:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163528448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746329.019701:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746329.019816:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528448 00000100:00100000:1.0:1788746329.019824:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528448 00000100:00100000:1.0:1788746329.019871:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788746329.019880:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163528448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746329.019911:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746329.019958:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163528448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746329.019965:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788746329.021206:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163528448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746329.137995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746329.138164:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526528 00000100:00100000:1.0:1788746329.138174:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526528 00000100:00100000:1.0:1788746329.138275:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 238 00000100:00100000:1.0:1788746329.138286:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:12287:x1875636141526528:12345-192.168.206.24@tcp:101:lsof.0 00010000:00010000:1.0:1788746329.138305:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746329.138325:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5ac expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138383:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138433:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138447:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746329.138478:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746329.138481:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746329.138515:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138556:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401a00/0xe59b64da5b30a906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5ac expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138576:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5ac expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746329.138584:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:1.0:1788746329.138586:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746329.138590:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401400, rc 0) 00000100:00100000:1.0:1788746329.138636:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:12287:x1875636141526528:12345-192.168.206.24@tcp:101:lsof.0 Request processed in 353us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746329.138649:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 238 00000100:00080000:2.0:1788746329.139647:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788746329.597415:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746330.109444:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788746330.109468:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746330.109989:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788746330.109998:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788746330.619388:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746330.647708:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746330.647750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746330.647780:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746330.647807:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746330.647839:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746330.647864:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141527168 00000100:00100000:0.0:1788746330.647873:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141527168 00000100:00100000:0.0:1788746330.647917:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526784 00000100:00100000:0.0:1788746330.647920:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526784 00000100:00100000:0.0:1788746330.647953:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 170 00000100:00100000:0.0:1788746330.647962:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2349:x1875636141527168:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746330.648027:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2349:x1875636141527168:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746330.648035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 170 00000100:00100000:0.0:1788746330.648052:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:0.0:1788746330.648058:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2349:x1875636141526784:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746330.648083:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:2349:x1875636141526784:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746330.648089:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 171 00000100:00100000:0.0:1788746330.648107:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526912 00000100:00100000:0.0:1788746330.648110:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526912 00000100:00100000:0.0:1788746330.648136:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141527040 00000100:00100000:0.0:1788746330.648139:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141527040 00000100:00100000:0.0:1788746330.648156:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 105 00000100:00100000:0.0:1788746330.648162:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141526912:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746330.648204:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2349:x1875636141526912:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746330.648210:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 105 00000100:00100000:2.0:1788746330.648361:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141526656 00000100:00100000:2.0:1788746330.648366:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141526656 00000100:00100000:2.0:1788746330.648392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 303 00000100:00100000:2.0:1788746330.648426:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141526656:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746330.648453:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd447584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141526656:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 55us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746330.648469:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 303 00000100:00080000:2.0:1788746330.648553:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746330.648557:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746330.648564:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746330.648720:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 106 00000100:00100000:0.0:1788746330.648731:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141527040:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746330.648765:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2349:x1875636141527040:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 37us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746330.653912:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 106 00000100:00100000:0.0:1788746331.149102:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746331.149201:0:12463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141527424 00000100:00100000:3.0:1788746331.149210:0:12463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141527424 00000100:00100000:3.0:1788746331.149314:0:12463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:3.0:1788746331.149325:0:12463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+18:12288:x1875636141527424:12345-192.168.206.24@tcp:35:umount.0 00000100:00100000:3.0:1788746331.149889:0:12463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+19:12288:x1875636141527424:12345-192.168.206.24@tcp:35:umount.0 Request processed in 564us (794us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788746331.149897:0:12463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 66 00000100:00100000:1.0:1788746331.153952:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746331.154088:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141527680 00000100:00100000:0.0:1788746331.154097:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141527680 00000100:00100000:0.0:1788746331.154147:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 67 00000100:00100000:0.0:1788746331.154158:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+19:12288:x1875636141527680:12345-192.168.206.24@tcp:35:umount.0 00000100:00100000:0.0:1788746331.154912:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+20:12288:x1875636141527680:12345-192.168.206.24@tcp:35:umount.0 Request processed in 753us (966us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788746331.154922:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 67 00000100:00100000:2.0:1788746331.159367:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746331.159680:0:12463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141527936 00000100:00100000:3.0:1788746331.159690:0:12463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141527936 00000100:00100000:3.0:1788746331.159841:0:12463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:3.0:1788746331.159852:0:12463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450ced050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+20:12288:x1875636141527936:12345-192.168.206.24@tcp:35:umount.0 00000100:00100000:3.0:1788746331.160098:0:12463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450ced050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:12288:x1875636141527936:12345-192.168.206.24@tcp:35:umount.0 Request processed in 247us (738us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788746331.160106:0:12463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 68 00000100:00100000:2.0:1788746331.166892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746331.167612:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141528192 00000100:00100000:1.0:1788746331.167623:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141528192 00000100:00100000:1.0:1788746331.167810:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:1.0:1788746331.167822:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+21:12288:x1875636141528192:12345-192.168.206.24@tcp:35:umount.0 00000100:00100000:1.0:1788746331.168152:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:783b9179-e60a-4972-9e46-67c8ee44ca13+22:12288:x1875636141528192:12345-192.168.206.24@tcp:35:umount.0 Request processed in 332us (1268us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788746331.168160:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 69 00000100:00100000:1.0:1788746331.174646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746331.174745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746331.185736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746331.188052:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141528448 00000100:00100000:2.0:1788746331.188066:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141528448 00000100:00100000:2.0:1788746331.188148:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141528320 00000100:00100000:2.0:1788746331.188151:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141528320 00000100:00100000:2.0:1788746331.188183:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:2.0:1788746331.188203:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+14:2349:x1875636141528448:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746331.188220:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746331.188238:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f941600/0xe59b64da5b3098f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b106 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.188255:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746331.188305:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+13:2349:x1875636141528448:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 114us (13667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746331.188312:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:2.0:1788746331.188344:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:2.0:1788746331.188350:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd461dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+12:2349:x1875636141528320:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746331.188358:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746331.188366:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd482042000/0xe59b64da5b309931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b13e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.188376:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746331.188432:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd461dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2349:x1875636141528320:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 81us (13686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746331.188439:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:1.0:1788746331.190263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746331.190290:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141528960 00000100:00100000:1.0:1788746331.190298:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141528960 00000100:00100000:1.0:1788746331.190339:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 72 00000100:00100000:1.0:1788746331.190346:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+7:2346:x1875636141528960:12345-192.168.206.24@tcp:9:umount.0 00000020:00000080:1.0:1788746331.190373:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309ecc 00000020:00010000:1.0:1788746331.190380:0:6682:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cd47d1ce800: total 0 00000100:00080000:1.0:1788746331.190385:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1cc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746331.190449:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788746331.190708:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2346:x1875636141528960:12345-192.168.206.24@tcp:9:umount.0 Request processed in 360us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746331.190715:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 72 00000020:00010000:1.0:1788746331.190735:0:8441:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cd47d1ce800: total 0 00010000:00010000:1.0:1788746331.190765:0:8441:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cd47d1ce800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788746331.190810:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e34f1b/0xe59b64da5b30a26f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3de expref: 4 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746331.190844:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30a8ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5a5 expref: 3 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746331.190860:0:8441:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cd47d1ce800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788746331.190871:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746331.190873:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746331.190875:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746331.191112:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141528576 00000100:00100000:0.0:1788746331.191118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141528576 00000100:00100000:0.0:1788746331.191160:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:0.0:1788746331.191168:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2349:x1875636141528576:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746331.191178:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746331.191199:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477401600/0xe59b64da5b309b7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b209 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746331.191213:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746331.191245:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141528576:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 78us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746331.191252:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:0.0:1788746331.216006:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746331.216143:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141529088 00000100:00100000:2.0:1788746331.216153:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141529088 00000100:00100000:2.0:1788746331.216308:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:2.0:1788746331.216319:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+5:2346:x1875636141529088:12345-192.168.206.24@tcp:9:umount.0 00000020:00000080:2.0:1788746331.216348:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309c6b 00000100:00080000:2.0:1788746331.216359:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1c8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788746331.216446:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788746331.218691:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746331.219909:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:783b9179-e60a-4972-9e46-67c8ee44ca13+2:2346:x1875636141529088:12345-192.168.206.24@tcp:9:umount.0 Request processed in 3582us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746331.219924:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 73 00000100:00100000:1.0:1788746331.240608:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746331.242276:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141530112 00000100:00100000:0.0:1788746331.242290:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141530112 00000100:00100000:0.0:1788746331.242356:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 239 00000100:00100000:0.0:1788746331.242367:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+22:2346:x1875636141530112:12345-192.168.206.24@tcp:39:umount.0 00000020:00000080:0.0:1788746331.242440:0:5851:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309907 00000020:00010000:0.0:1788746331.242458:0:5851:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cd445672000: total 0 00000100:00080000:0.0:1788746331.242462:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9cd445674800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746331.242488:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788746331.243069:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:783b9179-e60a-4972-9e46-67c8ee44ca13+21:2346:x1875636141530112:12345-192.168.206.24@tcp:39:umount.0 Request processed in 702us (2468us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788746331.243079:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 239 00000020:00010000:2.0:1788746331.243686:0:5837:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cd445672000: total 0 00010000:00010000:2.0:1788746331.243741:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cd445672000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788746331.243765:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:2.0:1788746331.243768:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788746331.243774:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b309c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b233 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243787:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746331.243789:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788746331.243791:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30a8ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b59e expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243800:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746331.243801:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746331.243803:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940000/0xe59b64da5b30a150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b391 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243811:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746331.243824:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788746331.243828:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44e00/0xe59b64da5b30a2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3fa expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243837:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd46e1acd00) 00010000:00010000:2.0:1788746331.243839:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746331.243851:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b309bed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b21e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243870:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cd46e1ac600) 00010000:00010000:2.0:1788746331.243872:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788746331.243876:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401c00/0xe59b64da5b30a5be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b4cc expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243893:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746331.243896:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746331.243900:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401000/0xe59b64da5b30a7e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b558 expref: 14 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243912:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746331.243915:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746331.243918:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45800/0xe59b64da5b30a230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3c9 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243929:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cd46e1ac100) 00010000:00010000:2.0:1788746331.243931:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788746331.243934:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30a25a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3d7 expref: 12 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746331.243962:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cd44773e100) 00010000:00010000:2.0:1788746331.243965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746331.243969:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8000/0xe59b64da5b30a8c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b590 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746331.244006:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746331.244010:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746331.244015:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f941e00/0xe59b64da5b30a2c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b3f3 expref: 10 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746331.244028:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cd444412e00) 00010000:00010000:3.0:1788746331.244031:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788746331.244034:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd45f940600/0xe59b64da5b309f2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b305 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746331.244050:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd46e1ac900) 00010000:00010000:3.0:1788746331.244052:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746331.244064:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45400/0xe59b64da5b309bd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b217 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746331.244080:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cd445672000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788746331.244097:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746331.244099:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746331.244101:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746331.580898:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746331.580923:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746331.580987:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746331.581125:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528576 00000100:00100000:1.0:1788746331.581133:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528576 00000100:00100000:1.0:1788746331.581187:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788746331.581196:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163528576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746331.581225:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746331.581264:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163528576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746331.581271:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788746331.581330:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746331.581783:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163528576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746331.642738:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746332.668925:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746333.251947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746333.251991:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746333.252030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746333.252113:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141530240 00000100:00100000:3.0:1788746333.252122:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141530240 00000100:00100000:3.0:1788746333.252185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141530368 00000100:00100000:3.0:1788746333.252193:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141530368 00000100:00100000:3.0:1788746333.252211:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141530496 00000100:00100000:3.0:1788746333.252214:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141530496 00000100:00100000:2.0:1788746333.252580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:2.0:1788746333.252596:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+12:2349:x1875636141530240:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746333.252612:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746333.252636:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f940a00/0xe59b64da5b3099d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b153 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746333.252653:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746333.252703:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2349:x1875636141530240:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 113us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746333.256252:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:3.0:1788746333.256275:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+11:2349:x1875636141530368:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746333.256294:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746333.256500:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441478e00/0xe59b64da5b3099e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b17d expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746333.256520:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746333.256580:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+10:2349:x1875636141530368:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 316us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746333.256589:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:3.0:1788746333.256610:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:3.0:1788746333.256631:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+9:2350:x1875636141530496:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746333.256641:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746333.256651:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477400000/0xe59b64da5b309b76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b202 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746333.256663:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746333.256681:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44bb9cf7-174c-4b10-9126-e74b4487a571+8:2350:x1875636141530496:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 52us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746333.256688:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:3.0:1788746333.256877:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746333.257001:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141530752 00000100:00100000:3.0:1788746333.257009:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141530752 00000100:00100000:3.0:1788746333.257059:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 240 00000100:00100000:3.0:1788746333.257067:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+6:2346:x1875636141530752:12345-192.168.206.24@tcp:39:umount.0 00000020:00000080:3.0:1788746333.257101:0:5849:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3099ee 00000020:00010000:3.0:1788746333.257109:0:5849:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cd47d1ad000: total 0 00000100:00080000:3.0:1788746333.257113:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9cd47d1af800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746333.257135:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788746333.257313:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc85ef4-d64f-49cc-8736-9bdf2adf468c+5:2346:x1875636141530752:12345-192.168.206.24@tcp:39:umount.0 Request processed in 246us (437us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788746333.257578:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 240 00000020:00010000:3.0:1788746333.257601:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cd47d1ad000: total 0 00010000:00010000:3.0:1788746333.257636:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cd47d1ad000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788746333.257660:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd44773e900) 00010000:00010000:3.0:1788746333.257664:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788746333.257671:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd477401400/0xe59b64da5b30a90d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5ac expref: 4 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746333.257708:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cd47d1ad000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788746333.259114:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746333.259122:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746333.259125:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788746333.259180:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746333.263424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:3.0:1788746333.276359:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746333.276933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531008 00000100:00100000:0.0:1788746333.276943:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531008 00000100:00100000:0.0:1788746333.277004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 304 00000100:00100000:0.0:1788746333.277015:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+7:2346:x1875636141531008:12345-192.168.206.24@tcp:251:umount.0 00000020:00000080:0.0:1788746333.277057:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3098e4 00000020:00010000:0.0:1788746333.277064:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cd476ffe800: total 0 00000100:00080000:0.0:1788746333.277069:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff9000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788746333.277150:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44bb9cf7-174c-4b10-9126-e74b4487a571+3:2346:x1875636141531008:12345-192.168.206.24@tcp:251:umount.0 Request processed in 136us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746333.277157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 304 00000020:00010000:3.0:1788746333.277374:0:5837:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cd476ffe800: total 0 00010000:00010000:3.0:1788746333.277379:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746333.277452:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cd476ffe800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788746333.277506:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd482043800/0xe59b64da5b309938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b145 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746333.277522:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cd476ffe800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788746333.277542:0:5837:0:(genops.c:885:class_export_put()) final put ffff9cd476ffe800/44bb9cf7-174c-4b10-9126-e74b4487a571 00010000:00010000:3.0:1788746333.277552:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746333.277554:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746333.277555:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788746333.279094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476ffe800/44bb9cf7-174c-4b10-9126-e74b4487a571 for MGS 00000020:00000080:0.0:1788746333.279146:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd476ff9000 for MGS 00000100:00100000:2.0:1788746333.626982:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627042:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627079:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163529216:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627100:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627120:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746333.627125:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163528832:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627150:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627163:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163529344:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627188:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627210:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627228:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627242:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746333.627246:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163529088:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627277:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746333.627306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528704 00000100:00100000:2.0:1788746333.627312:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528704 00000100:00100000:2.0:1788746333.627350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788746333.627358:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627415:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163528704:12345-0@lo:400:kworker.0 Request processed in 39us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746333.627422:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788746333.627454:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529216 00000100:00100000:2.0:1788746333.627457:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529216 00000100:00100000:2.0:1788746333.627483:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528832 00000100:00100000:2.0:1788746333.627485:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528832 00000100:00100000:2.0:1788746333.627494:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163528960 00000100:00100000:2.0:1788746333.627496:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163528960 00000100:00100000:2.0:1788746333.627507:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788746333.627512:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163529216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627555:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875636163529216:12345-0@lo:400:kworker.0 Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746333.627560:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788746333.627571:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788746333.627582:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163528832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627604:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163528832:12345-0@lo:400:kworker.0 Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746333.627610:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788746333.627619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788746333.627624:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627646:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163528960:12345-0@lo:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746333.627651:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788746333.627679:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746333.627701:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627878:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163528832:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627886:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788746333.627894:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163529216:0@lo:400:kworker.0 00000100:00100000:1.0:1788746333.628175:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529344 00000100:00100000:1.0:1788746333.628179:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529344 00000100:00100000:1.0:1788746333.628208:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529088 00000100:00100000:1.0:1788746333.628215:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529088 00000100:00100000:1.0:1788746333.628232:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788746333.628238:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746333.628278:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163529344:12345-0@lo:400:kworker.0 Request processed in 39us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746333.628284:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788746333.628294:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788746333.628300:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163529088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746333.628332:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163529088:12345-0@lo:400:kworker.0 Request processed in 33us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746333.628337:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788746333.628363:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746333.628368:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746333.628391:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163529088:0@lo:400:kworker.0 00000100:00100000:1.0:1788746333.628445:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163529344:0@lo:400:kworker.0 00010000:00010000:3.0:1788746333.693721:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746333.703801:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:2.0:1788746333.703809:0:6706:0:(genops.c:885:class_export_put()) final put ffff9cd47d1cd000/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:0.0:1788746333.703875:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47d1cd000/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-OST0000 00000020:00000080:0.0:1788746333.703922:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd47d1c8800 for lustre-OST0000 00000100:00100000:1.0:1788746334.139327:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163529472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746334.139393:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746334.139487:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529472 00000100:00100000:1.0:1788746334.140011:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529472 00000100:00100000:1.0:1788746334.140153:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788746334.140164:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163529472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746334.140210:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746334.140259:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163529472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746334.140265:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788746334.140340:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163529472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788746334.716473:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788746334.945243:0:12951:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788746334.982805:0:12951:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788746334.982849:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746334.982862:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746334.982883:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746334.982890:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746334.982915:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788746334.982920:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788746334.982950:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746334.982954:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788746334.982958:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788746334.983097:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746334.983104:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983112:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd482043600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746334.983116:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983124:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746334.983131:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746334.983137:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746334.983139:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788746334.983142:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788746334.983176:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983182:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746334.983213:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983221:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd482043600/0xe59b64da5b309977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30997e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983231:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746334.983233:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746334.983240:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746334.983249:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746334.983265:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163529600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.983321:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.983376:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529600 00000100:00100000:0.0:1788746334.983382:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529600 00000100:00100000:0.0:1788746334.983451:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746334.983459:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3316:x1875636163529600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746334.983470:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746334.983482:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44800/0xe59b64da5b30997e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309977 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.983576:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746334.983610:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3316:x1875636163529600:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.983616:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746334.983652:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163529600:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788746334.983877:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd477f25800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788746334.984267:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163529728:0@lo:39:umount.0 00000100:00100000:0.0:1788746334.984314:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746334.985136:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529728 00000100:00100000:1.0:1788746334.985144:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529728 00000100:00100000:1.0:1788746334.985192:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788746334.985200:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875636163529728:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788746334.985222:0:5851:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3096f3 00000100:00080000:1.0:1788746334.985230:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9cd476f8e800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788746334.985294:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1875636163529728:12345-0@lo:39:umount.0 Request processed in 94us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746334.985300:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788746334.985308:0:5851:0:(genops.c:885:class_export_put()) final put ffff9cd476f8f800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788746334.985602:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746334.985646:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd477f25800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788746334.985662:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163529728:0@lo:39:umount.0 00000100:00080000:1.0:1788746334.985878:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788746334.985882:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788746334.985886:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788746334.987091:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476f8f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788746334.987144:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd476f8e800 for lustre-MDT0000 00010000:00010000:1.0:1788746334.989247:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989265:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989271:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989277:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989302:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746334.989309:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989315:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989327:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989332:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989354:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788746334.989360:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989366:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989371:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989377:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989646:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788746334.989655:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989663:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989669:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746334.989687:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993212:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788746334.993225:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993237:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f940200 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746334.993258:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993269:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746334.993277:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746334.993284:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746334.993287:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788746334.993322:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993328:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746334.993357:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993364:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd45f940200/0xe59b64da5b309985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b30998c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993383:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788746334.993387:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993394:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ac00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746334.993423:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993430:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746334.993446:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746334.993452:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746334.993455:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788746334.993457:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788746334.993470:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993476:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746334.993482:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993500:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd44e09ac00/0xe59b64da5b30989e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b3098a5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993528:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788746334.993532:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993537:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd45f941800 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746334.993540:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993546:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746334.993552:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746334.993568:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788746334.993570:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788746334.993572:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788746334.993587:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993593:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746334.993608:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993615:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd45f941800/0xe59b64da5b309ba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993624:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746334.993629:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993635:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746334.993638:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993644:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746334.993651:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746334.993656:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746334.993658:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788746334.993668:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993679:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746334.993686:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.993694:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746334.993696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746334.993698:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746334.993719:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163529856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.993791:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.993834:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746334.993840:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163529984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.993862:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.993888:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163530240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.993909:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.993923:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746334.993928:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163530112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.993946:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.993991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529856 00000100:00100000:0.0:1788746334.993999:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529856 00000100:00100000:0.0:1788746334.994031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163529984 00000100:00100000:0.0:1788746334.994033:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163529984 00000100:00100000:0.0:1788746334.994042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163530240 00000100:00100000:0.0:1788746334.994044:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163530240 00000100:00100000:0.0:1788746334.994052:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163530112 00000100:00100000:0.0:1788746334.994054:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163530112 00000100:00100000:0.0:1788746334.994066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746334.994073:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+21:3314:x1875636163529856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746334.994092:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746334.994104:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479c00/0xe59b64da5b30998c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309985 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.994115:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746334.994144:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+20:3314:x1875636163529856:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.994150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746334.994165:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746334.994170:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd461dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+19:3314:x1875636163529984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746334.994177:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746334.994185:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f941000/0xe59b64da5b3098a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b30989e expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.994194:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746334.994212:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd461dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+18:3314:x1875636163529984:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.994217:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746334.994249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788746334.994254:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+17:3317:x1875636163530240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746334.994260:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746334.994268:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09bc00/0xe59b64da5b309659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309652 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.994278:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746334.994300:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+16:3317:x1875636163530240:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.994315:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788746334.994327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746334.994332:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+15:3317:x1875636163530112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746334.994338:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746334.994345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477401200/0xe59b64da5b309ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309ba0 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746334.994356:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746334.994375:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85baee7e-e9e8-492f-b3b0-167696ca895f+14:3317:x1875636163530112:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.994380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746334.994432:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163530112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.994441:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85baee7e-e9e8-492f-b3b0-167696ca895f:3317:1875636163530240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.994464:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163529984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746334.994470:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85baee7e-e9e8-492f-b3b0-167696ca895f:3314:1875636163529856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746334.994972:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746334.994980:0:12951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b309652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746334.994993:0:12951:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788746334.994998:0:12951:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788746334.995001:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788746334.995032:0:12951:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788746334.995036:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788746334.995040:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746334.995045:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788746334.995050:0:12951:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9cd476ffa000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788746334.995055:0:12951:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9cd3452a7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788746334.995061:0:12951:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9cd47d1ad000 acc85ef4-d64f-49cc-8736-9bdf2adf468c 192.168.206.24@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788746334.995066:0:12951:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9cd445672000 783b9179-e60a-4972-9e46-67c8ee44ca13 192.168.206.24@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:1.0:1788746334.995070:0:12951:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9cd477f2b380) has exports, disconnecting them 00000020:00080000:1.0:1788746334.995074:0:12951:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cd476ffa000), last request at 1788746333 00000020:00000080:1.0:1788746334.995080:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309866 00000100:00080000:1.0:1788746334.995096:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788746334.995142:0:12951:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd476ffa000): rc 0 00000020:00000080:1.0:1788746334.995145:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd476ffa000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788746334.995155:0:12951:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cd3452a7800), last request at 1788746333 00000020:00000080:1.0:1788746334.995159:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30979b 00000100:00080000:1.0:1788746334.995172:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788746334.995179:0:12951:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd3452a7800): rc 0 00000020:00000080:1.0:1788746334.995181:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd3452a7800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788746334.995188:0:12951:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb85481e73ae0 00000100:00080000:1.0:1788746334.995203:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788746334.995206:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788746334.995219:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788746334.995277:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788746334.995292:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd45fa5a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788746334.995303:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788746334.995305:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788746334.995313:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788746334.995375:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788746334.995383:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788746334.995606:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746334.995620:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163530368:0@lo:9:umount.0 00000100:00100000:0.0:1788746334.995661:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.995687:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163530496:0@lo:9:umount.0 00000100:00100000:0.0:1788746334.995706:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746334.995738:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163530368 00000100:00100000:0.0:1788746334.995744:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163530368 00000100:00100000:0.0:1788746334.995788:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163530496 00000100:00100000:0.0:1788746334.995791:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163530496 00000100:00100000:0.0:1788746334.995820:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788746334.995827:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875636163530368:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788746334.995845:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3097e8 00000100:00080000:0.0:1788746334.995852:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd344955800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746334.995878:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788746334.996162:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3313:x1875636163530368:12345-0@lo:9:umount.0 Request processed in 334us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.996170:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788746334.996182:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788746334.996188:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875636163530496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788746334.996198:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3098cf 00000100:00080000:0.0:1788746334.996204:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9cd47ebcc000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746334.996217:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788746334.996296:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3313:x1875636163530496:12345-0@lo:9:umount.0 Request processed in 108us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746334.996302:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788746334.996324:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746334.996344:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd45fa5a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788746334.996348:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788746334.996350:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746334.996354:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163530368:0@lo:9:umount.0 00000100:00080000:0.0:1788746334.996363:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd476ff8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788746334.996372:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788746334.996373:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746334.996376:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163530496:0@lo:9:umount.0 00010000:00010000:0.0:1788746334.996846:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788746334.996934:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9cd477f2b380) has no exports 00010000:00010000:2.0:1788746334.997085:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788746334.997176:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476ffa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788746334.997441:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788746334.998111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd3452a7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788746334.998224:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd476ff8000 for lustre-MDT0000 00000020:00000080:2.0:1788746334.998230:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd3452a4000 for lustre-MDT0000 00000020:00080000:1.0:1788746335.003154:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9cd477f2b380) has no exports 00000020:00000080:1.0:1788746335.087779:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3096ad 00000020:00000080:1.0:1788746335.087793:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f09800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788746335.087813:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788746335.088462:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f09800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788746335.089109:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746335.089120:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788746335.089135:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9cd477f28000) has no exports 00000020:00000080:0.0:1788746335.092369:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3096a6 00000020:00000080:0.0:1788746335.092379:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd47ebc9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788746335.092710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47ebc9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788746335.093068:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746335.093079:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788746335.093082:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd47ebcd800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788746335.093085:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47ebcd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788746335.093093:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1788746335.229551:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000001:00080000:3.0:1788746335.229566:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:3.0:1788746335.229579:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000001:00080000:3.0:1788746335.229584:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788746335.229588:0:5871:0:(genops.c:885:class_export_put()) final put ffff9cd47d1ad000/acc85ef4-d64f-49cc-8736-9bdf2adf468c 00000020:00000080:3.0:1788746335.229602:0:5871:0:(genops.c:885:class_export_put()) final put ffff9cd445672000/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:3.0:1788746335.229618:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47d1ad000/acc85ef4-d64f-49cc-8736-9bdf2adf468c for lustre-MDT0000 00000020:00000080:3.0:1788746335.229661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445672000/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-MDT0000 00000020:00000080:3.0:1788746335.229698:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd47d1af800 for lustre-MDT0000 00000020:00000080:3.0:1788746335.229704:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd445674800 for lustre-MDT0000 00000001:00100000:3.0:1788746335.235082:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746335.235090:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cd476fff000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788746335.235117:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:3.0:1788746335.235119:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cd47d1ce800/783b9179-e60a-4972-9e46-67c8ee44ca13 00000020:00000080:0.0:1788746335.235259:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476fff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788746335.235309:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47d1ce800/783b9179-e60a-4972-9e46-67c8ee44ca13 for lustre-OST0001 00000020:00000080:0.0:1788746335.235328:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd47ebcc000 for lustre-OST0001 00000020:00000080:0.0:1788746335.235332:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd47d1cc000 for lustre-OST0001 00010000:00010000:0.0:1788746335.738950:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746336.770014:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788746337.146543:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd3475c5180 - data ffff9cd344e44510/ffff9cd47d0bb400 00000020:01000000:0.0:1788746337.146669:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd467c5b5a0 - data ffff9cd45d760360/ffff9cd47db94400 00000001:00000004:0.0:1788746337.153555:0:12951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1788746337.289183:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788746337.289190:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788746337.289203:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788746337.289206:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788746337.289670:0:6960:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788746337.289674:0:6960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788746337.289682:0:6960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788746337.291639:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788746337.291646:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788746337.291687:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746337.291690:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788746337.292215:0:8055:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788746337.292219:0:8055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788746337.292228:0:8055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788746337.391027:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309675 00000020:00000080:0.0:1788746337.391040:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f26800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788746337.392004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f26800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788746337.392858:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30968a 00000020:00000080:0.0:1788746337.392867:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f21000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746337.392926:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788746337.392933:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.392941:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788746337.392954:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9cd445094d40) has no exports 00000004:01000000:0.0:1788746337.393099:0:12951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788746337.393106:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3098c8 00000020:00000080:0.0:1788746337.393110:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd476ffb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746337.396141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f21000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788746337.396298:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788746337.396308:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.396320:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746337.396324:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9cd4462719c0) has no exports 00000020:00000080:0.0:1788746337.396333:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3098c1 00000020:00000080:0.0:1788746337.396340:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd476ffc800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788746337.396751:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788746337.396999:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788746337.397003:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788746337.397009:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746337.397011:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746337.397042:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.397049:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746337.397056:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3097e1 00000020:00000080:0.0:1788746337.397061:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd47d5fa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746337.397066:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788746337.397070:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.397074:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746337.397076:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9cd3452ccd40) has no exports 00000020:00000080:0.0:1788746337.397080:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3097da 00000020:00000080:0.0:1788746337.397083:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd45fa59800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788746337.397431:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788746337.397435:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788746337.397437:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788746337.397441:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746337.397442:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746337.397464:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.397469:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746337.397525:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.397530:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746337.397533:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd44ef13800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746337.398179:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476ffb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788746337.398189:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476ffc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788746337.398194:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd476ff8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788746337.398201:0:8:0:(genops.c:885:class_export_put()) final put ffff9cd476ffc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746337.398203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd476ffc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788746337.398207:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788746337.398282:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47d5fa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788746337.398287:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45fa59800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788746337.398291:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45fa5a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788746337.398294:0:8:0:(genops.c:885:class_export_put()) final put ffff9cd45fa5c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746337.398296:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45fa5c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788746337.398299:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746337.398621:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd44ef13800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788746337.398628:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746337.399022:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309691 00000020:00000080:0.0:1788746337.399029:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f23000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788746337.399045:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788746337.399051:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.399058:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788746337.399061:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9cd477f2cd40) has no exports 00000020:00000080:0.0:1788746337.399092:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.399097:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788746337.399101:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309698 00000020:00000080:0.0:1788746337.399105:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f25000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788746337.399113:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd448caf000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788746337.399116:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448caf000 3 00000020:01000004:0.0:1788746337.399119:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cd448caf000 from lustre-MDT0000 00000020:00000080:0.0:1788746337.399213:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.399218:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788746337.399221:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f20000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788746337.399223:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f20000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788746337.399232:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788746337.399261:0:12951:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788746337.399265:0:12951:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788746337.399268:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788746337.399270:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.399273:0:12951:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788746337.399279:0:12951:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9cd447745000 85baee7e-e9e8-492f-b3b0-167696ca895f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788746337.399284:0:12951:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9cd4450919c0) has exports, disconnecting them 00000020:00080000:0.0:1788746337.399288:0:12951:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cd447745000), last request at 1788746107 00000020:00000080:0.0:1788746337.399301:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309636 00000020:00010000:0.0:1788746337.399314:0:12951:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cd447745000: total 2 00000100:00080000:0.0:1788746337.399319:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9cd45116c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788746337.399338:0:12951:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd447745000): rc 0 00000020:00080000:0.0:1788746337.399342:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9cd4450919c0) has no exports 00000020:00000080:3.0:1788746337.399493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f23000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788746337.399498:0:8:0:(genops.c:885:class_export_put()) final put ffff9cd477f27800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788746337.399500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f27800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788746337.399513:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788746337.399672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f25000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788746337.400054:0:8441:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cd447745000: total 0 00010000:00010000:2.0:1788746337.400095:0:8441:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cd447745000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788746337.400139:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd482042400/0xe59b64da5b309970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309969 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400159:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f941a00/0xe59b64da5b309b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309b92 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400170:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45e00/0xe59b64da5b30974e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309747 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400183:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd45f940800/0xe59b64da5b309b8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309b84 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400197:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd44e09a600/0xe59b64da5b30999a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b309993 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400208:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479600/0xe59b64da5b309946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b30993f expref: 4 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400218:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441478c00/0xe59b64da5b309954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b30994d expref: 3 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400227:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd482042600/0xe59b64da5b309962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe59b64da5b30995b expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746337.400237:0:8441:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cd447745000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788746337.400250:0:8441:0:(genops.c:885:class_export_put()) final put ffff9cd447745000/85baee7e-e9e8-492f-b3b0-167696ca895f 00010000:00010000:2.0:1788746337.400267:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746337.400268:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746337.400270:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746337.400301:0:5844:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cd4447c8a00:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788746337.400390:0:5843:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cd4447c9c00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788746337.400460:0:5842:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cd446c41e00:5842] 0 exiting: rc = 1 00000020:00000080:3.0:1788746337.400671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd447745000/85baee7e-e9e8-492f-b3b0-167696ca895f for MGS 00000020:00000080:3.0:1788746337.400706:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45116c800 for MGS 00000100:00100000:0.0:1788746337.401096:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401104:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401109:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401115:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401119:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401145:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401151:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401155:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401161:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401167:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401172:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401177:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401182:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401187:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401192:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401197:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401201:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401206:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401212:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401218:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401223:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401227:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401232:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401237:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401243:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401248:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401253:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401259:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401264:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401269:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401273:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401288:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401293:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401299:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401304:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401309:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401313:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401318:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401322:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401327:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401332:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401338:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401343:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401348:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401354:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401359:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401365:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401370:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401375:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401381:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401386:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401391:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401423:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401430:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401435:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401441:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401446:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401451:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401456:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401461:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401465:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401470:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401485:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.401491:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788746337.402267:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788746337.402271:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788746337.406547:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd446f93660 - data ffff9cd47c7a6510/ffff9cd45faf3c00 00000020:01000000:0.0:1788746337.406683:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd467c5b000 - data ffff9cd45d5f6288/ffff9cd450150400 00000020:00000080:0.0:1788746337.407389:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30961a 00000020:00000080:0.0:1788746337.407847:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd445120800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788746337.407913:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd448caf000 from MGS, refs=2 00000020:01000004:0.0:1788746337.407917:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448caf000 2 00000020:01000004:0.0:1788746337.407920:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cd448caf000 from MGS 00000020:00000080:0.0:1788746337.407940:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746337.407947:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788746337.407950:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd445123000/MGS 00000020:00000080:0.0:1788746337.407952:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445123000/MGS for MGS 00000020:01000000:0.0:1788746337.407961:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788746337.408013:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788746337.408018:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746337.408023:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788746337.408030:0:12951:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cd477f0e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788746337.408036:0:12951:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9cd447513380) has exports, disconnecting them 00000020:00080000:0.0:1788746337.408040:0:12951:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cd477f0e800), last request at 1788746108 00000020:00000080:0.0:1788746337.408044:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b3096e5 00000020:00080000:0.0:1788746337.408054:0:12951:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd477f0e800): rc 0 00000020:00000080:0.0:1788746337.408058:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f0e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788746337.413436:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445120800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788746337.414716:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f0e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788746337.433661:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788746337.433669:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788746337.433674:0:12951:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746337.433682:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788746337.433733:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd477f25800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788746337.433849:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746337.433857:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788746337.433862:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd477f08000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788746337.433865:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f08000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788746337.433877:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788746337.434782:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448caf000 1 00000020:00000080:1.0:1788746337.434789:0:12951:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30960c 00000020:00000080:1.0:1788746337.434804:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd445125000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788746337.434824:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788746337.434828:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746337.434833:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788746337.434837:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9cd445090000) has no exports 00000020:00000080:3.0:1788746337.437975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445125000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788746337.482719:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746337.482733:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788746337.482737:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd448ca9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788746337.482741:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd448ca9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788746337.482747:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788746337.482850:0:12951:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cd448cab800 00000020:01000000:1.0:1788746337.482866:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788746337.482870:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746337.482874:0:12951:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788746337.482878:0:12951:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9cd446270000) has no exports 00000100:00100000:1.0:1788746337.482944:0:8618:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9cd45fac0800:8618] 3 exiting: rc = 0 00000100:00100000:1.0:1788746337.483034:0:5850:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9cd44572e600:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788746337.483108:0:5851:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9cd44627b200:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1788746337.485386:0:5849:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9cd44572f800:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788746337.486439:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486447:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486453:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486459:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486464:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486469:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486475:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486480:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486487:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486492:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486518:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486526:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486531:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486537:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486543:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486559:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486564:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486570:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486575:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486579:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486584:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486589:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486594:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486598:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486602:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486607:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486617:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486624:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486629:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486634:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486639:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486645:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486650:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486655:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486660:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486665:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486670:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486675:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486680:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486685:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486690:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486695:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486700:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486705:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486710:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486715:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486722:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486727:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486732:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486737:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486750:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486756:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486760:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486766:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486771:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486776:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486781:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486786:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486792:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486797:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486803:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486819:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486827:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746337.486833:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.494140:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cd4451c9000:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1788746337.494239:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cd44627ac00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788746337.495967:0:12463:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9cd48004cc00:12463] 2 exiting: rc = 0 00000100:00100000:2.0:1788746337.496598:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496606:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496621:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496626:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496632:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496637:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496643:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496648:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496655:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496661:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496666:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496673:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496684:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496975:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496984:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496989:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496994:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.496999:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497004:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497009:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497014:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497019:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497024:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497029:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497034:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497041:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497047:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497052:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497057:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497062:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497080:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497085:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497090:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497095:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497100:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497105:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497110:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497116:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497121:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497213:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497219:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497224:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497230:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497234:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497239:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497244:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497250:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497255:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497260:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497265:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497270:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497275:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497280:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497285:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497290:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497295:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497299:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497304:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497309:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497313:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497318:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497322:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497327:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.497332:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.499228:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9cd4450bfa00:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788746337.501353:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9cd4450bfe00:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1788746337.501659:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501679:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501685:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501691:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501698:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501703:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501969:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501977:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501983:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501990:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.501997:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502002:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502008:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502013:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502019:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502025:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502032:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502038:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502060:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502067:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502074:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502081:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502087:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502092:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502098:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502104:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502109:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502114:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502119:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502197:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502217:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502557:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502568:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502574:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502580:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502586:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502605:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502610:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502616:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502622:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502628:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502633:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502660:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502667:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502673:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502706:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502984:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502992:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.502999:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503004:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503012:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503018:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503023:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503028:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503051:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503057:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503063:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503070:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503076:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503082:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503090:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503096:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503102:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.503119:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.525491:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cd4450bf400:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1788746337.528024:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cd4450bf200:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1788746337.528622:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528630:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528636:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528641:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528646:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528652:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528670:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528675:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528680:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528685:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528690:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528695:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528700:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528706:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528952:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528961:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528967:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528971:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528977:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528982:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528986:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528991:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.528996:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529002:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529006:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529011:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529016:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529021:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529026:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529030:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529035:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529040:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529044:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529049:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529055:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529060:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529065:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529069:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529075:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529080:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529085:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529098:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529103:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529108:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529113:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529118:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529190:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529199:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529204:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529209:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529213:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529217:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529222:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529226:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529230:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529234:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529239:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529243:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529247:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529252:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529267:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529271:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529276:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.529280:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.530521:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cd4450bf600:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1788746337.530976:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cd4450bee00:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1788746337.531094:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531101:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531106:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531111:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531116:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531120:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531200:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531207:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531212:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531217:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531222:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531227:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531243:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531248:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531253:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531257:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531262:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531267:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531272:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531277:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531281:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531286:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531291:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531296:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531300:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531305:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531309:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531314:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531319:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531323:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531328:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531333:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531338:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531343:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531348:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531353:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531358:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531362:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531368:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531372:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531377:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531383:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531388:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531392:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531562:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531570:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531575:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531587:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531592:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531597:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531602:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531606:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531611:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531615:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531620:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531624:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531629:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531633:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531639:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531644:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531649:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531653:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531658:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.531664:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746337.532545:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cd443f18e00:5860] 0 exiting: rc = 1 00000100:00100000:2.0:1788746337.533108:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cd443f19600:5861] 1 exiting: rc = 0 00000100:00100000:3.0:1788746337.533280:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533287:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533292:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533297:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533302:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533307:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533311:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533316:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533321:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533326:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533331:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533336:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533341:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533347:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533351:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533356:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533360:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533365:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533369:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533374:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533378:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533382:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533387:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533391:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.533395:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534228:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534233:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534238:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534242:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534247:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534251:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534255:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534260:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534264:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534269:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534273:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534277:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534282:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534287:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534292:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534297:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534301:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534305:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534309:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534314:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534319:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534323:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534328:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534333:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534338:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534343:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534348:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534353:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534357:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534362:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534366:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534370:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534375:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534379:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534383:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534394:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534591:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534599:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.534604:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746337.535564:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9cd4450be600:5862] 0 exiting: rc = 1 00000100:00100000:0.0:1788746337.536114:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9cd443f3e600:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1788746337.537202:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9cd443f18c00:5864] 2 exiting: rc = 0 00000100:00100000:3.0:1788746337.538915:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538925:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538931:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538945:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538951:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538970:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538977:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538983:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538988:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.538995:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539001:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539006:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539014:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539019:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539025:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539031:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539036:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539041:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539047:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539052:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539056:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539062:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539067:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539072:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539079:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539084:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539088:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539094:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539100:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539122:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539275:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539294:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539300:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539306:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539312:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539317:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539323:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539329:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539335:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539341:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539347:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539352:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539358:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539363:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539370:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539376:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539382:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539388:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539394:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539575:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539582:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539586:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539592:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539613:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539619:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539625:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539630:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539636:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539642:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539648:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539654:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539660:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539665:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746337.539672:0:12951:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788746337.562330:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746337.562342:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788746337.562347:0:12951:0:(genops.c:885:class_export_put()) final put ffff9cd46e1c1000/MDS_uuid 00000020:00000080:2.0:1788746337.562351:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd46e1c1000/MDS_uuid for MDS 00000020:01000000:2.0:1788746337.562362:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788746337.563321:0:12951:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788746337.794941:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746338.746612:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163530752:0@lo:400:kworker.0 00000400:00000100:2.0:1788746338.746663:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163530752 offset 0 length 224: 4 00000100:00100000:2.0:1788746338.746716:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788746338.746722:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163530624:0@lo:400:kworker.0 00000400:00000100:2.0:1788746338.746741:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636163530624 offset 0 length 224: 4 00000100:00100000:2.0:1788746338.746766:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163530880:0@lo:400:kworker.0 00000400:00000100:2.0:1788746338.746936:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163530880 offset 0 length 224: 4 00010000:00010000:3.0:1788746338.811849:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788746338.820613:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788746338.820627:0:6706:0:(genops.c:885:class_export_put()) final put ffff9cd344956000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788746338.820787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd344956000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788746338.820834:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd344955800 for lustre-OST0000 00010000:00010000:0.0:1788746339.835799:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788746340.258976:0:13103:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788746340.275913:0:13103:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788746340.275958:0:13103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746340.275973:0:13103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746340.275980:0:13103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746340.275987:0:13103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746340.276009:0:13103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788746340.276015:0:13103:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788746340.276036:0:13103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746340.276046:0:13103:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd344b54380 x1875636163530752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746340.276067:0:13103:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788746340.276073:0:13103:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788746340.276097:0:13103:0:(import.c:65:import_set_state_nolock()) ffff9cd477f22800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788746340.276115:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163530752:0@lo:400:kworker.0 00000100:00100000:0.0:1788746340.276435:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163531008:0@lo:39:umount.0 00000400:00000100:0.0:1788746340.276483:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163531008 offset 0 length 224: 4 00010000:00010000:1.0:1788746340.276568:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746340.276577:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746340.276587:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746340.276591:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746340.276612:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746340.276620:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746340.276626:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746340.276635:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788746340.276638:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788746340.276662:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746340.276668:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746340.276695:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746340.276703:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479400/0xe59b64da5b30995b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe59b64da5b309962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746340.276714:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746340.276716:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746340.276718:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746340.276854:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746340.276867:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163531136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746340.276902:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746340.276943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163531136 00000100:00100000:1.0:1788746340.276950:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163531136 00000100:00100000:1.0:1788746340.276990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746340.276998:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3316:x1875636163531136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788746340.277004:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788746340 with bad export cookie 16544928545071207990 00000100:00100000:2.0:1788746340.288075:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3316:x1875636163531136:12345-0@lo:103:ldlm_bl.0 Request processed in 11068us (11163us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788746340.288089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788746340.288143:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788746340.288150:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9cd4457ad000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788746340.288153:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788746340.292688:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.124@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788746340.292693:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788746340.292702:0:3316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd344b56d80 x1875636163530624/t0(0) o400->MGC192.168.206.124@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788746354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746340.292721:0:3316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd450080000 x1875636163531136/t0(0) o103->MGC192.168.206.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788746356 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788746340.292749:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788746340.292752:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788746340.292753:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788746340.292757:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9cd4457ad000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746340.292761:0:3316:0:(import.c:545:import_select_connection()) MGC192.168.206.124@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:1.0:1788746340.292774:0:3316:0:(import.c:666:import_select_connection()) MGC192.168.206.124@tcp: import ffff9cd4457ad000 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746340.292873:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85baee7e-e9e8-492f-b3b0-167696ca895f:3315:1875636163530624:0@lo:400:kworker.0 00000100:00100000:1.0:1788746340.293589:0:3316:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd450082300 x1875636163531264/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746340.293624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163531264:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788746340.294279:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636163531264 offset 0 length 520: 4 00000100:00100000:1.0:1788746340.294333:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85baee7e-e9e8-492f-b3b0-167696ca895f:3316:1875636163531136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746340.860326:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746341.882974:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746342.907556:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746343.866877:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746343.866886:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746343.867006:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163531392:0@lo:400:kworker.0 00000400:00000100:0.0:1788746343.867052:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163531392 offset 0 length 224: 4 00010000:00010000:1.0:1788746343.930953:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746344.890533:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746344.890542:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746344.890809:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746344.890827:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163531520:0@lo:400:kworker.0 00000400:00000100:0.0:1788746344.890878:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163531520 offset 0 length 224: 4 00010000:00010000:0.0:1788746344.955284:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746345.980377:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746347.002684:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746348.026625:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746349.050780:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788746350.010775:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788746350.010784:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788746350.010892:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746350.010912:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163531648:0@lo:400:kworker.0 00000400:00000100:2.0:1788746350.010961:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163531648 offset 0 length 224: 4 00010000:00010000:3.0:1788746350.074671:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746350.522547:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746340/real 1788746340] req@ffff9cd450082300 x1875636163531264/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746350 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746350.522577:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd450082300 x1875636163531264/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746350 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746350.522588:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746340/real 1788746340] req@ffff9cd344b56680 x1875636163531008/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746350 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746350.522600:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd344b56680 x1875636163531008/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746350 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746350.522615:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4457ad000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746350.522649:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788746350.522653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163531264:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788746350.522659:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd477f22800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788746350.522676:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163531008:0@lo:39:umount.0 00000100:00080000:2.0:1788746350.522786:0:13103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746350.522791:0:13103:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788746350.522795:0:13103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788746350.523778:0:13103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523791:0:13103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523798:0:13103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523804:0:13103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523834:0:13103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746350.523840:0:13103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523846:0:13103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523852:0:13103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523866:0:13103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746350.523878:0:13103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788746350.523882:0:13103:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788746350.523901:0:13103:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788746350.523905:0:13103:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788746350.523910:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746350.523915:0:13103:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788746350.523919:0:13103:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9cd447510000) has no exports 00000020:00080000:2.0:1788746350.523941:0:13103:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9cd447510000) has no exports 00000020:01000000:2.0:1788746350.525626:0:13103:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd467c22420 - data ffff9cd44f074360/ffff9cd45f4e8000 00000100:00080000:3.0:1788746350.526057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788746350.526063:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788746350.526066:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cd4457ad000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746350.526072:0:8:0:(import.c:545:import_select_connection()) MGC192.168.206.124@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1788746350.526078:0:8:0:(import.c:630:import_select_connection()) MGC192.168.206.124@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788746350.526089:0:8:0:(import.c:666:import_select_connection()) MGC192.168.206.124@tcp: import ffff9cd4457ad000 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:3.0:1788746350.526122:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd48001ce00 x1875636163531776/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1788746350.526801:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746350.526811:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526821:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479200 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746350.526824:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526833:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746350.526840:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746350.526845:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746350.526848:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788746350.526850:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788746350.526864:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:1.0:1788746350.526868:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526874:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479200/0xe59b64da5b309969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526886:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746350.526903:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526908:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400200 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746350.526911:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526918:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746350.526923:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746350.526928:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788746350.526930:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788746350.526932:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788746350.526938:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:1.0:1788746350.526941:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526947:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd477400200/0xe59b64da5b309b92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309b99 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746350.526959:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746350.526961:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746350.526962:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746350.526969:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746350.526984:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163531776:0@lo:250:kworker.0 00000400:00000100:1.0:1788746350.527027:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636163531776 offset 0 length 520: 4 00000020:01000000:2.0:1788746350.531583:0:13103:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd44fe59060 - data ffff9cd45d7cb798/ffff9cd344bc5400 00100000:10000000:2.0:1788746350.545943:0:13103:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788746350.590990:0:13103:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30976a 00000020:00000080:0.0:1788746350.590999:0:13103:0:(genops.c:885:class_export_put()) final put ffff9cd34504d000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788746350.591018:0:13103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd448dea800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788746350.591021:0:13103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448dea800 2 00000020:01000004:0.0:1788746350.591024:0:13103:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cd448dea800 from lustre-OST0000 00000020:00000080:0.0:1788746350.591042:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746350.591051:0:13103:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788746350.591054:0:13103:0:(genops.c:885:class_export_put()) final put ffff9cd448de8800/lustre-OST0000_UUID 00000020:00000080:0.0:1788746350.591057:0:13103:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd448de8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788746350.591063:0:13103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788746350.591110:0:13103:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788746350.591123:0:13103:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788746350.591127:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746350.591131:0:13103:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788746350.591137:0:13103:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cd47ebc8000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788746350.591143:0:13103:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9cd3452cb380) has exports, disconnecting them 00000020:00080000:0.0:1788746350.591147:0:13103:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cd47ebc8000), last request at 1788746125 00000020:00000080:0.0:1788746350.591151:0:13103:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309794 00000020:00080000:0.0:1788746350.591159:0:13103:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd47ebc8000): rc 0 00000020:00000080:0.0:1788746350.591163:0:13103:0:(genops.c:885:class_export_put()) final put ffff9cd47ebc8000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788746350.592387:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd34504d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:1.0:1788746350.592550:0:13103:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788746350.592563:0:13103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788746350.592567:0:13103:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746350.592572:0:13103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788746350.592731:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746350.592739:0:13103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788746350.592744:0:13103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448dea800 1 00000020:00000080:1.0:1788746350.592749:0:13103:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309724 00000020:00000080:1.0:1788746350.592756:0:13103:0:(genops.c:885:class_export_put()) final put ffff9cd4485bf000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788746350.592760:0:13103:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788746350.592765:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746350.592768:0:13103:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788746350.592771:0:13103:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9cd477f299c0) has no exports 00000020:00000080:3.0:1788746350.594143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd47ebc8000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788746350.594155:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd477f22800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788746350.594160:0:8:0:(genops.c:885:class_export_put()) final put ffff9cd44eea6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788746350.594163:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd44eea6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788746350.594166:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788746350.594384:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd4485bf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788746350.634495:0:13103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746350.634508:0:13103:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788746350.634512:0:13103:0:(genops.c:885:class_export_put()) final put ffff9cd448de9800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788746350.634517:0:13103:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd448de9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788746350.634526:0:13103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788746350.634659:0:13103:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cd448ded000 00000020:02000400:3.0:1788746350.634867:0:13103:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788746351.102780:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746352.124792:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746353.149321:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788746353.738190:0:13255:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788746353.746724:0:13255:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788746353.746793:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746353.746807:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746353.746814:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746353.746821:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746353.746847:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788746353.746852:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788746353.746871:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788746353.746881:0:13255:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd344b57100 x1875636163530880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746353.746919:0:13255:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd344b57b80 x1875636163531392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746353.746934:0:13255:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd344b54a80 x1875636163531520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746353.746943:0:13255:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd48001c700 x1875636163531648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746353.746953:0:13255:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788746353.746979:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163531520:0@lo:400:kworker.0 00000100:00100000:0.0:1788746353.746986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875636163531392:0@lo:400:kworker.0 00000100:00080000:0.0:1788746353.747011:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788746353.747034:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788746353.747097:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875636163530880:0@lo:400:kworker.0 00010000:00010000:2.0:1788746353.747210:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746353.747217:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746353.747224:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd482043e00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746353.747227:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746353.747235:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746353.747241:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746353.747246:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788746353.747254:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788746353.747257:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788746353.747270:0:8441:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:2.0:1788746353.747274:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746353.747280:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd482043e00/0xe59b64da5b30993f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746353.747292:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746353.747293:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746353.747295:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746353.747310:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163531648:0@lo:400:kworker.0 00000100:00100000:0.0:1788746353.747681:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163531904:0@lo:39:umount.0 00000400:00000100:0.0:1788746353.747723:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636163531904 offset 0 length 224: 4 00010000:00010000:0.0:1788746354.175705:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746355.197040:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746355.644456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746355.644469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788746356.218713:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746357.246260:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746358.266708:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746359.291969:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746360.322779:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788746360.766654:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788746360.766668:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788746361.341288:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746362.363022:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746363.386541:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746363.962696:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746353/real 1788746353] req@ffff9cd45f98aa00 x1875636163531904/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746363.962738:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd45f98aa00 x1875636163531904/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788746363.962754:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd45f4f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788746363.962773:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163531904:0@lo:39:umount.0 00000100:00080000:2.0:1788746363.964432:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746363.964440:0:13255:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788746363.964447:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788746363.969019:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969056:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969064:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969087:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969116:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746363.969123:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969129:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969135:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969140:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746363.969161:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788746363.969166:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788746363.969186:0:13255:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788746363.969191:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788746363.969195:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746363.969200:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788746363.969204:0:13255:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9cd45fbbcd40) has no exports 00000020:00080000:2.0:1788746363.969227:0:13255:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9cd45fbbcd40) has no exports 00010000:00010000:1.0:1788746363.970708:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746363.970719:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970729:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd482043000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746363.970733:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970741:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746363.970749:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746363.970755:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746363.970758:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788746363.970760:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788746363.970777:0:8441:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:1.0:1788746363.970780:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970803:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd482043000/0xe59b64da5b30994d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309954 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970816:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746363.970820:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970825:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8e00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746363.970828:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970834:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746363.970840:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746363.970844:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788746363.970846:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788746363.970849:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788746363.970854:0:8441:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:1.0:1788746363.970856:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970861:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f8e00/0xe59b64da5b309b84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b309b8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746363.970871:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746363.970873:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746363.970879:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746363.971832:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788746363.972991:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd467c22960 - data ffff9cd47c699948/ffff9cd477404000 00000020:01000000:2.0:1788746363.973814:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cd47d34e600 - data ffff9cd47c7a0510/ffff9cd45f4e6800 00100000:10000000:2.0:1788746363.985035:0:13255:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788746364.061680:0:13255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309835 00000020:00000080:2.0:1788746364.061698:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd445675000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788746364.061710:0:13255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd47ebce000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788746364.061713:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd47ebce000 2 00000020:01000004:2.0:1788746364.061717:0:13255:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cd47ebce000 from lustre-OST0001 00000020:00000080:0.0:1788746364.061761:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445675000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788746364.061804:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746364.061814:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788746364.061817:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd445673800/lustre-OST0001_UUID 00000020:00000080:2.0:1788746364.061819:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445673800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788746364.061918:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788746364.062227:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 85baee7e-e9e8-492f-b3b0-167696ca895f->MGS 00010000:00010000:2.0:1788746364.062242:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746364.062255:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746364.062261:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788746364.062624:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788746364.062627:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788746364.062640:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:2.0:1788746364.062644:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd441479a00/0xe59b64da5b309747 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b30974e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746364.062660:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746364.062666:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746364.062672:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788746364.062674:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788746364.062675:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788746364.062691:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cd4457ad000 00010000:00010000:2.0:1788746364.062693:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd45f941200/0xe59b64da5b309993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe59b64da5b30999a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788746364.062707:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9cd4457ad000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788746364.062711:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788746364.062713:0:13255:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788746364.062714:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788746364.062718:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788746364.062728:0:13255:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cd48001ce00 x1875636163531776/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788746365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788746364.062779:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788746364.062783:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1788746364.062828:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85baee7e-e9e8-492f-b3b0-167696ca895f:3313:1875636163531776:0@lo:250:kworker.0 10000000:01000000:2.0:1788746364.062970:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788746364.062978:0:13255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309628 00000020:00000080:2.0:1788746364.062983:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd46e1c7000/85baee7e-e9e8-492f-b3b0-167696ca895f 00000020:01000000:2.0:1788746364.062995:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.124@tcp (flags='') 00000020:00000080:2.0:1788746364.063000:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746364.063005:0:13255:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788746364.063012:0:13255:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9cd445093380) has no exports 00000020:00000080:1.0:1788746364.063054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd46e1c7000/85baee7e-e9e8-492f-b3b0-167696ca895f for MGC192.168.206.124@tcp 10000000:01000000:2.0:1788746364.063682:0:5846:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788746364.063781:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.124@tcp: client import never connected 00000100:00080000:1.0:1788746364.063784:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788746364.063787:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788746364.063789:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788746364.063791:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788746364.063831:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746364.063838:0:13255:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.124@tcp (uuid 85baee7e-e9e8-492f-b3b0-167696ca895f) 00000020:01000000:1.0:1788746364.063858:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788746364.063863:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746364.063867:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788746364.063872:0:13255:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cd45f4f7000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788746364.063877:0:13255:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9cd4475119c0) has exports, disconnecting them 00000020:00080000:1.0:1788746364.063881:0:13255:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cd45f4f7000), last request at 1788746145 00000020:00000080:1.0:1788746364.063884:0:13255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b30985f 00000020:00080000:1.0:1788746364.063895:0:13255:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cd45f4f7000): rc 0 00000020:00000080:1.0:1788746364.063900:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd45f4f7000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788746364.063996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f4f7000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788746364.065233:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788746364.065240:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788746364.065244:0:13255:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746364.065250:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788746364.065337:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd45f4f6800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788746364.066041:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746364.066050:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788746364.066055:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd45f48a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788746364.066059:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd45f48a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788746364.066064:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788746364.066117:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd47ebce000 1 00000020:00000080:1.0:1788746364.066122:0:13255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xe59b64da5b309804 00000020:00000080:1.0:1788746364.066129:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd477f26000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788746364.066192:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788746364.066198:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746364.066203:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788746364.066206:0:13255:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9cd45fbbb380) has no exports 00000020:00000080:2.0:1788746364.068606:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd477f26000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788746364.068920:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cd4457ad000 for MGC192.168.206.124@tcp 00000020:00000080:2.0:1788746364.068933:0:38:0:(genops.c:885:class_export_put()) final put ffff9cd4457a9800/85baee7e-e9e8-492f-b3b0-167696ca895f 00000020:00000080:2.0:1788746364.068935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd4457a9800/85baee7e-e9e8-492f-b3b0-167696ca895f for MGC192.168.206.124@tcp 00000020:01000000:2.0:1788746364.068940:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.124@tcp (85baee7e-e9e8-492f-b3b0-167696ca895f) 00010000:00010000:0.0:1788746364.069266:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788746364.069791:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788746364.069921:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788746364.070074:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788746364.070248:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cd458780200:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1788746364.070296:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cd458781600:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1788746364.070583:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.070814:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cd46e156a00:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1788746364.070911:0:8442:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cd447501200:8442] 3 exiting: rc = 0 00000100:00100000:2.0:1788746364.071217:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cd4485b3c00:5835] 1 exiting: rc = 0 00000100:00100000:2.0:1788746364.071267:0:5836:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cd46e156800:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788746364.071318:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.071325:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072068:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072076:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072082:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072088:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072093:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072099:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072104:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072110:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072115:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072121:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072127:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072133:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072139:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072145:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072151:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072156:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072161:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072166:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072171:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072176:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072181:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072185:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072190:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072196:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072200:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072205:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072210:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072215:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072220:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072226:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072231:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072247:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072251:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072256:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072274:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072280:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072284:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072289:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072294:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072298:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072303:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072309:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072314:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072318:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.072323:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075143:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075166:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075172:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075177:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075183:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075188:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075193:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075198:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075204:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075209:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075214:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075224:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075234:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075240:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075245:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075252:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.075316:0:38:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788746364.100967:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746364.100982:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788746364.100987:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd445671000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788746364.100992:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd445671000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788746364.101002:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788746364.101185:0:13255:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cd445673000 00000020:01000000:0.0:1788746364.101206:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788746364.101210:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746364.101214:0:13255:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788746364.101218:0:13255:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9cd447514d40) has no exports 00000020:00000080:0.0:1788746364.101243:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746364.101248:0:13255:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788746364.101251:0:13255:0:(genops.c:885:class_export_put()) final put ffff9cd4485bc800/OSS_uuid 00000020:00000080:0.0:1788746364.101253:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9cd4485bc800/OSS_uuid for OSS 00000020:01000000:0.0:1788746364.101256:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788746364.101653:0:8456:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9cd446338e00:8456] 3 exiting: rc = 0 00000100:00100000:0.0:1788746364.101745:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9cd48002a200:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1788746364.101791:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9cd48002a400:6681] 1 exiting: rc = 0 00000100:00080000:2.0:1788746364.104702:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788746364.106616:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9cd48002b000:6682] 2 exiting: rc = 0 00000100:00100000:2.0:1788746364.106762:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106771:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106779:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106802:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106807:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106812:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106817:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106824:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106829:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106835:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106840:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106856:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106862:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106867:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106874:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106879:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106885:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106891:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106897:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106903:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106910:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106916:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106925:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.106930:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107048:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107058:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107062:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107067:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107071:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107076:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107081:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107085:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107090:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107096:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107101:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107106:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107111:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107116:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107129:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107135:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107141:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107147:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107153:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107158:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107163:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107169:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107174:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107179:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107185:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107190:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107196:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107202:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107207:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107219:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107227:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107236:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107242:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107248:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107253:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107257:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107262:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107267:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107273:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.107278:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.111068:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cd45085da00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1788746364.111898:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cd48002ac00:6683] 0 exiting: rc = 1 00000100:00100000:0.0:1788746364.112604:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112613:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112632:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112641:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112649:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112658:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112663:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112667:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112671:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112675:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112681:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112686:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112690:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112695:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112700:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112705:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112709:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112716:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112721:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112726:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112731:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112736:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112740:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112745:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112749:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112754:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112759:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112764:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112769:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112774:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112780:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112785:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112790:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112796:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112800:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112805:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112810:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112823:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112828:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112833:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112837:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.112843:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113075:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113083:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113089:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113093:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113099:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113104:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113108:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113117:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113124:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113131:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113140:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113150:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113156:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113166:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113176:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113199:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113209:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113214:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113249:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113256:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113260:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.113267:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.114439:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cd45001c800:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1788746364.114820:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cd47d700400:6687] 2 exiting: rc = 0 00000100:00100000:3.0:1788746364.116736:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cd47d700200:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1788746364.117017:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117025:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117031:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117036:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117041:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117059:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117065:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117070:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117076:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117083:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117090:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117097:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117106:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117112:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117117:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117158:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117166:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117172:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117177:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117183:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117188:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117193:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117198:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117203:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117222:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117229:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117238:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117946:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117954:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117959:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117964:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117969:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117975:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117979:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117984:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117989:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117994:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.117998:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118003:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118008:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118020:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118025:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118030:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118035:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118039:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118045:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118050:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118056:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118079:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118086:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118092:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118101:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118108:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118117:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118123:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118129:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118140:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118148:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118153:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118158:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118163:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118168:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118173:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.118178:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746364.129853:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cd446339200:6688] 0 exiting: rc = 1 00000100:00100000:2.0:1788746364.129965:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cd47d4f7000:6689] 1 exiting: rc = 0 00000100:00100000:2.0:1788746364.130035:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130042:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130048:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130054:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130059:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130064:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130069:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130075:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130080:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130085:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130102:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130106:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130112:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130117:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130122:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130128:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130133:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130138:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130143:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130148:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130154:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130160:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130165:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130172:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130178:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130190:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130240:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130647:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130734:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130742:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130749:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130755:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130759:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130764:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130768:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130773:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130779:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130784:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130789:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130795:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130802:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130812:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130818:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130823:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130828:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130842:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130848:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130853:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130858:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130863:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130869:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130874:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130879:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130884:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130889:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130894:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130904:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130912:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130959:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130967:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130976:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130981:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130987:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746364.130991:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746364.133682:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cd45f448800:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788746364.134008:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cd45f449600:6691] 1 exiting: rc = 0 00000100:00100000:3.0:1788746364.134242:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134259:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134285:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134293:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134298:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134303:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134315:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134321:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134327:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134332:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134338:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134370:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134381:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134389:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134394:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134428:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134434:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134441:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134449:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134456:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134463:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134468:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134476:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134508:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134515:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134523:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134529:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134534:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134539:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134545:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134563:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134570:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134575:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134582:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134589:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134624:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134643:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134653:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134798:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134809:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134821:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134831:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134842:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134853:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134869:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134881:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134892:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134936:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134946:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134952:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134959:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134966:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134976:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134982:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134988:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.134994:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135002:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135008:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135027:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135054:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135062:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135068:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135074:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746364.135088:0:13255:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788746364.154831:0:13255:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788746382.919370:0:13870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788746391.867679:0:14332:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746391.867686:0:14332:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788746391.867797:0:14332:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cd448410800 00000020:01000004:3.0:1788746391.867812:0:14332:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788746391.867819:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788746391.867832:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cd45fbb8000) 00000020:00000080:3.0:1788746391.867845:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788746391.903914:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788746391.907750:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788746391.912208:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 547: rc = 0 00100000:10000000:3.0:1788746391.912864:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 547: rc = 0 00100000:10000000:3.0:1788746391.912973:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 547: rc = 0 00100000:10000000:3.0:1788746391.913178:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788746391.913848:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 547: rc = 0 00100000:10000000:3.0:1788746391.913994:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 547: rc = 0 00100000:10000000:3.0:1788746391.914173:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 547: rc = 0 00100000:10000000:3.0:1788746391.915026:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 549: rc = 0 00100000:10000000:3.0:1788746391.918984:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 420: rc = 0 00100000:10000000:3.0:1788746391.919647:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 420: rc = 0 00100000:10000000:3.0:1788746391.921978:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 423: rc = 0 00100000:10000000:3.0:1788746391.922928:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 423: rc = 0 00100000:10000000:3.0:1788746391.926735:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.933750:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.938777:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.939168:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 423: rc = 0 00100000:10000000:2.0:1788746391.941928:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 423: rc = 0 00100000:10000000:2.0:1788746391.942299:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.948451:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 423: rc = 0 00100000:10000000:2.0:1788746391.949065:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.949991:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1788746391.951818:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 423: rc = 0 00100000:10000000:2.0:1788746391.954677:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 439: rc = 0 00100000:10000000:2.0:1788746391.955042:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 439: rc = 0 00100000:10000000:2.0:1788746391.958012:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 439: rc = 0 00100000:10000000:2.0:1788746391.958896:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 439: rc = 0 00100000:10000000:2.0:1788746391.959178:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 439: rc = 0 00100000:10000000:2.0:1788746391.959941:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 439: rc = 0 00100000:10000000:3.0:1788746391.962843:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 439: rc = 0 00100000:10000000:1.0:1788746391.967783:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 439: rc = 0 00100000:10000000:1.0:1788746391.972561:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 439: rc = 0 00100000:10000000:1.0:1788746391.972839:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 439: rc = 0 00100000:10000000:1.0:1788746391.973180:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 439: rc = 0 00100000:10000000:1.0:1788746391.975736:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 439: rc = 0 00100000:10000000:1.0:1788746391.976572:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 439: rc = 0 00100000:10000000:1.0:1788746391.976862:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 439: rc = 0 00100000:10000000:1.0:1788746391.977140:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 439: rc = 0 00100000:10000000:1.0:1788746391.977696:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 439: rc = 0 00100000:10000000:1.0:1788746391.977944:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 439: rc = 0 00100000:10000000:1.0:1788746391.978604:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 439: rc = 0 00100000:10000000:1.0:1788746391.978852:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 439: rc = 0 00100000:10000000:1.0:1788746391.979637:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 439: rc = 0 00100000:10000000:1.0:1788746391.979962:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 439: rc = 0 00100000:10000000:1.0:1788746391.980260:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 439: rc = 0 00100000:10000000:1.0:1788746391.980547:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 439: rc = 0 00100000:10000000:1.0:1788746391.980801:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 439: rc = 0 00100000:10000000:1.0:1788746391.981058:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 439: rc = 0 00100000:10000000:1.0:1788746391.981327:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 439: rc = 0 00100000:10000000:1.0:1788746391.981623:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 439: rc = 0 00100000:10000000:1.0:1788746391.981891:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 439: rc = 0 00100000:10000000:1.0:1788746391.982135:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 439: rc = 0 00100000:10000000:1.0:1788746391.982433:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 439: rc = 0 00100000:10000000:1.0:1788746391.982678:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 439: rc = 0 00100000:10000000:1.0:1788746391.983946:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 439: rc = 0 00100000:10000000:1.0:1788746391.984761:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 153: rc = 0 00100000:10000000:1.0:1788746391.985882:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788746391.986140:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:1.0:1788746391.986654:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788746391.986722:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 689: rc = 0 00100000:10000000:1.0:1788746391.986919:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788746391.986989:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 689: rc = 0 00100000:10000000:1.0:1788746391.987728:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788746391.987804:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 421: rc = 0 00100000:10000000:1.0:1788746391.987989:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788746391.988142:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 421: rc = 0 00100000:10000000:1.0:1788746391.988640:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788746391.988711:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 421: rc = 0 00000020:00000080:1.0:1788746391.988962:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788746391.988969:0:14332:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788746391.988980:0:14332:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a91b 00000020:01000004:1.0:1788746391.988989:0:14332:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788746391.988993:0:14332:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788746391.988998:0:14332:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd448410800 from MGS 00000020:01000004:1.0:1788746391.989001:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788746391.989091:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cd3452c8000) 00000020:00000080:1.0:1788746391.989104:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788746391.989158:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd448410800 from MGS, refs=2 00080000:01000000:1.0:1788746391.989170:0:14332:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788746391.989175:0:14332:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a929 00000100:00100000:1.0:1788746391.989505:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788746391.989628:0:14332:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788746391.989633:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788746391.990601:0:14332:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788746391.990610:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788746391.991692:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746391.991871:0:14332:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788746391.991876:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788746391.992792:0:14332:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788746391.992800:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788746391.993760:0:14332:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788746391.993769:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788746392.004027:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.004032:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.004034:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.004620:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.004623:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.004625:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746392.005104:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788746392.011131:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788746392.021949:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788746392.021965:0:14332:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788746392.021967:0:14332:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788746392.030250:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788746392.031964:0:14332:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788746392.032093:0:14332:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788746392.032695:0:14332:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788746392.032989:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746392.033142:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788746392.033148:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788746392.039085:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788746392.039097:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788746392.039759:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788746392.039766:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788746392.040653:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788746392.040673:0:14332:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.124@tcp' 00000020:01000004:2.0:1788746392.040675:0:14332:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788746392.040702:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.124@tcp (typ=mgc) 00000020:00000080:2.0:1788746392.040714:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.124@tcp (ffff9cd447514d40) 00000020:00000080:2.0:1788746392.040729:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788746392.040796:0:14332:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd4461d0800@MGC192.168.206.124@tcp: add connection 192.168.206.124@tcp at head 00010000:00010000:2.0:1788746392.040944:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.124@tcp-0 is initialized 00000040:01000000:2.0:1788746392.040951:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788746392.041122:0:14346:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788746392.042333:0:14347:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788746392.042739:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.124@tcp (uuid 3ea63f15-cd19-459c-bd52-18aa65dbbcba) 00000020:00000080:2.0:1788746392.042758:0:14332:0:(genops.c:1384:class_connect()) connect: client 3ea63f15-cd19-459c-bd52-18aa65dbbcba, cookie 0xe59b64da5b30a937 00000100:00080000:2.0:1788746392.042769:0:14332:0:(import.c:545:import_select_connection()) MGC192.168.206.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746392.042779:0:14332:0:(import.c:666:import_select_connection()) MGC192.168.206.124@tcp: import ffff9cd4461d0800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:2.0:1788746392.042811:0:14332:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd344b54700 x1875636163532032/t0(0) o250->MGC192.168.206.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788746392.042837:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3ea63f15-cd19-459c-bd52-18aa65dbbcba->MGS 00000020:01000004:2.0:1788746392.042863:0:14332:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788746392.042867:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788746392.042878:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cd4475119c0) 00000020:00000080:2.0:1788746392.042887:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788746392.043001:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3313:1875636163532032:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788746392.043072:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746392.045426:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532032 00000100:00100000:3.0:1788746392.045445:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532032 00000100:00100000:3.0:1788746392.045488:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746392.045495:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875636163532032:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788746392.045522:0:14343:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 3ea63f15-cd19-459c-bd52-18aa65dbbcba@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1788746392.045550:0:14343:0:(genops.c:1384:class_connect()) connect: client 3ea63f15-cd19-459c-bd52-18aa65dbbcba, cookie 0xe59b64da5b30a945 00000100:00080000:3.0:1788746392.045689:0:14343:0:(import.c:65:import_set_state_nolock()) ffff9cd345049000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746392.045770:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:3313:x1875636163532032:12345-0@lo:250:mount.lustre.0 Request processed in 274us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.045778:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746392.045938:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788746392.045948:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.124@tcp: connect to target with instance 0 00000100:00080000:1.0:1788746392.045955:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788746392.045960:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788746392.045963:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4461d0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788746392.045965:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788746392.045982:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788746392.045988:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3313:1875636163532032:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788746392.070164:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746392.070686:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746392.070693:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788746392.071968:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788746392.071978:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788746392.072712:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788746392.072720:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788746392.073451:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746392.073619:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788746392.073625:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788746392.074824:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788746392.074833:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788746392.151689:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746392.151885:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788746392.151891:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788746392.158779:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788746392.158799:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788746392.160449:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746392.160650:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788746392.160657:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788746392.162364:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788746392.162374:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788746392.164001:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746392.164196:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788746392.164202:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788746392.165940:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788746392.165950:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788746392.166543:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746392.166705:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788746392.166710:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788746392.167120:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788746392.167128:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788746392.196719:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746392.196930:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788746392.196938:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788746392.198768:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788746392.198782:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788746392.199892:0:14332:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788746392.199902:0:14332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788746392.200772:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788746392.200796:0:14332:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788746392.200801:0:14332:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788746392.200931:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788746392.200964:0:14332:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.124@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788746392.200969:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788746392.200971:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788746392.200972:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746392.200974:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746392.200978:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746392.200979:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746392.200981:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746392.200982:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788746392.200984:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746392.200985:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746392.200987:0:14332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788746392.200990:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746392.200991:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788746392.200992:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746392.200993:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746392.200994:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746392.200995:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746392.200996:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746392.200997:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788746392.200998:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746392.200999:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746392.201104:0:14332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788746392.201125:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788746392.201194:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.201378:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.201553:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532160 00000100:00100000:0.0:1788746392.201563:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532160 00000100:00100000:0.0:1788746392.201647:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746392.201657:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:14332:x1875636163532160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788746392.201702:0:14345:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788746392.201706:0:14345:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788746392.201709:0:14345:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788746392.202168:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788746392.202704:0:14345:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788746392.203795:0:14366:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788746392.203808:0:14366:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788746392.203811:0:14366:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788746392.203849:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788746392.204187:0:14345:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788746392.204276:0:14345:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788746392.213930:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:14332:x1875636163532160:12345-0@lo:253:mount.lustre.0 Request processed in 12266us (12726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.213945:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746392.214095:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788746392.214111:0:14332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788746392.214114:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788746392.214116:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788746392.214117:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746392.214119:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746392.214120:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746392.214121:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746392.214122:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746392.214124:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788746392.214126:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746392.214127:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788746392.214145:0:14332:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd448410800 from lustre-MDT0000 10000000:01000000:1.0:1788746392.214172:0:14332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788746392.214176:0:14332:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788746392.214181:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cd447514d40 10000000:01000000:1.0:1788746392.214274:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788746392.214285:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cd447514d40 from 1 10000000:01000000:1.0:1788746392.214288:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788746392.214322:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.214333:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.214341:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.214361:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746392.214542:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.214608:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.214654:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532288 00000100:00100000:0.0:1788746392.214660:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532288 00000100:00100000:0.0:1788746392.214745:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746392.214754:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:14332:x1875636163532288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746392.214767:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746392.214782:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f9a00/0xe59b64da5b30a953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30a94c expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.214803:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f9a00/0xe59b64da5b30a953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30a94c expref: 6 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.214814:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f9a00/0xe59b64da5b30a953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a94c expref: 6 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.214823:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9a00, rc 0) 00000100:00100000:0.0:1788746392.214867:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+6:14332:x1875636163532288:12345-0@lo:101:mount.lustre.0 Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.214874:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746392.214941:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746392.214954:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.214963:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.215026:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746392.215052:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.215237:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746392.215377:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532416 00000100:00100000:3.0:1788746392.215382:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532416 00000100:00100000:3.0:1788746392.215424:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746392.215432:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+6:14332:x1875636163532416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746392.215660:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+6:14332:x1875636163532416:12345-0@lo:501:mount.lustre.0 Request processed in 228us (607us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788746392.215669:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746392.215758:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532416:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788746392.215786:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788746392.215875:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.215893:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746392.215902:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd448410800 10000000:01000000:1.0:1788746392.215906:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788746392.215911:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cd448410800 10000000:01000000:1.0:1788746392.215913:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788746392.215916:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cd448410800 from 1 10000000:01000000:1.0:1788746392.215919:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788746392.215942:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.215951:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.215960:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.215974:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746392.215999:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.216037:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.216160:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532544 00000100:00100000:0.0:1788746392.216165:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532544 00000100:00100000:0.0:1788746392.216190:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746392.216196:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+6:14332:x1875636163532544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746392.216217:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746392.216245:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f9e00/0xe59b64da5b30a961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30a95a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.216263:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f9e00/0xe59b64da5b30a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30a95a expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.216272:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f9e00/0xe59b64da5b30a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a95a expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.216280:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9e00, rc 0) 00000100:00100000:0.0:1788746392.216308:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+7:14332:x1875636163532544:12345-0@lo:101:mount.lustre.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.216315:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746392.216452:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746392.216463:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a961 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.216472:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30a961 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746392.216494:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788746392.216696:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a961 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.216705:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477401200/0xe59b64da5b30a95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a961 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746392.216712:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788746392.216716:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788746392.216721:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cd448410800 10000000:01000000:1.0:1788746392.216724:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788746392.216727:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788746392.216729:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788746392.216745:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.216752:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.216759:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.216773:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746392.216803:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.216868:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.216912:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532672 00000100:00100000:0.0:1788746392.216917:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532672 00000100:00100000:0.0:1788746392.216951:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746392.216958:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+7:14332:x1875636163532672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746392.216966:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746392.216975:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8a00/0xe59b64da5b30a96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30a968 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.216989:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8a00/0xe59b64da5b30a96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30a968 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.216998:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8a00/0xe59b64da5b30a96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a968 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.217122:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8a00, rc 0) 00000100:00100000:0.0:1788746392.217290:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+8:14332:x1875636163532672:12345-0@lo:101:mount.lustre.0 Request processed in 331us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.217307:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746392.217386:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746392.217511:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a96f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.217527:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30a96f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.217576:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746392.217604:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.217670:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746392.217713:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532800 00000100:00100000:3.0:1788746392.217718:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532800 00000100:00100000:3.0:1788746392.217794:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746392.217803:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+8:14332:x1875636163532800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746392.218271:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14332:x1875636163532800:12345-0@lo:501:mount.lustre.0 Request processed in 469us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.218279:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746392.218357:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746392.218389:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746392.218460:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.218768:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.218864:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163532928 00000100:00100000:2.0:1788746392.218869:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163532928 00000100:00100000:2.0:1788746392.218897:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746392.218905:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14332:x1875636163532928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746392.219247:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14332:x1875636163532928:12345-0@lo:503:mount.lustre.0 Request processed in 341us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.219264:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746392.219491:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163532928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746392.219973:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14367:1875636163533056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746392.220030:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.220063:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.220169:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533056 00000100:00100000:2.0:1788746392.220175:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533056 00000100:00100000:2.0:1788746392.220215:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746392.220232:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14367:x1875636163533056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746392.220512:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14367:x1875636163533056:12345-0@lo:502:llog_process_th.0 Request processed in 288us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.220519:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788746392.220678:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14367:1875636163533056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746392.220707:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746392.220717:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746392.220719:0:14367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788746392.220725:0:14367:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788746392.220727:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746392.220741:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cd3452c99c0) 00000020:00000080:1.0:1788746392.220757:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788746392.220762:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788746392.220821:0:14367:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788746392.220828:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a97d 00000020:00000080:1.0:1788746392.221046:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788746392.221051:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746392.221055:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746392.221057:0:14367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788746392.221060:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746392.221063:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746392.221065:0:14367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788746392.221068:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746392.221075:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cd3452cb380) 00000020:00000080:1.0:1788746392.221085:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788746392.221089:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788746392.221091:0:14367:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788746392.221093:0:14367:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788746392.221098:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788746392.221135:0:14367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd448410800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788746392.221148:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cd3452ccd40) 00000020:00000080:1.0:1788746392.221155:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788746392.221349:0:14367:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788746392.221356:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30a992 00000020:00000080:1.0:1788746392.221479:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788746392.221485:0:14367:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788746392.221489:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe59b64da5b30a999 00080000:01000000:1.0:1788746392.221493:0:14367:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788746392.221496:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a9a0 00010000:00010000:3.0:1788746392.330291:0:14367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788746392.330946:0:14367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1788746392.331280:0:14367:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788746392.331916:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cd45fbb99c0) 00000020:00000080:3.0:1788746392.331935:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788746392.332328:0:14367:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788746392.332335:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a9ae 00000020:00000080:2.0:1788746392.333438:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788746392.352150:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe59b64da5b30a9b5 00000020:00000080:2.0:1788746392.353128:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788746392.353139:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746392.353147:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.353149:0:14367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788746392.353153:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788746392.353156:0:14367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788746392.353157:0:14367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788746392.353159:0:14367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788746392.353160:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788746392.353163:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.353164:0:14367:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788746392.353167:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746392.353171:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.353173:0:14367:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788746392.353177:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788746392.353357:0:14367:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788746392.353377:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746392.353380:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.353382:0:14367:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788746392.353384:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788746392.353418:0:14367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788746392.353423:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.353424:0:14367:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788746392.353428:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788746392.353433:0:14367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.124@tcp to nid 0x20000c0a8ce7c (192.168.206.124@tcp) 00000020:01000000:2.0:1788746392.353455:0:14367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788746392.353458:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788746392.353471:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cd447510000) 00000020:00000080:2.0:1788746392.353487:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788746392.353492:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788746392.353544:0:14367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788746392.353550:0:14367:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788746392.353556:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a9c3 00010000:00080000:2.0:1788746392.353586:0:14367:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd3452a7800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:2.0:1788746392.353869:0:14367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788746392.357722:0:14367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788746392.357799:0:14367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788746392.363820:0:14367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746392.363889:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788746392.363969:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788746392.365262:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788746392.365268:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788746392.366116:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746392.366129:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788746392.366161:0:14367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788746392.366178:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30a9ca 00000100:00080000:2.0:1788746392.366189:0:14367:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746392.366286:0:14367:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cd3452a7800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:2.0:1788746392.366323:0:14367:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd344b55180 x1875636163533184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746392.366432:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163533184:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788746392.366479:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636163533184 offset 0 length 520: 4 00000100:00080000:2.0:1788746392.366587:0:14367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788746392.366678:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746392.366682:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.366684:0:14367:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788746392.366687:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788746392.366690:0:14367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788746392.366692:0:14367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788746392.366693:0:14367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788746392.366695:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788746392.366697:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.366699:0:14367:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788746392.366702:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788746392.366706:0:14367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788746392.366709:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.366710:0:14367:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788746392.366713:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788746392.366717:0:14367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.124@tcp to nid 0x20000c0a8ce7c (192.168.206.124@tcp) 00000020:01000000:2.0:1788746392.366738:0:14367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788746392.366741:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788746392.366753:0:14367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cd447513380) 00000020:00000080:2.0:1788746392.366764:0:14367:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788746392.366768:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788746392.366819:0:14367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788746392.366825:0:14367:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788746392.366831:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe59b64da5b30a9d8 00010000:00080000:2.0:1788746392.366970:0:14367:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd4521dd800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:2.0:1788746392.367196:0:14367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788746392.367434:0:14367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788746392.367457:0:14367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788746392.367941:0:14367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746392.368010:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788746392.368099:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000020:00000080:3.0:1788746392.370617:0:14367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788746392.370633:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788746392.370663:0:14367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788746392.370682:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30a9df 00000100:00080000:3.0:1788746392.370693:0:14367:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746392.370706:0:14367:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd4521dd800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:3.0:1788746392.370742:0:14367:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd48001ca80 x1875636163533312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746392.370763:0:14367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788746392.370817:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746392.370822:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.370824:0:14367:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788746392.370827:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746392.370831:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.370832:0:14367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788746392.370835:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788746392.370837:0:14367:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788746392.370840:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746392.370842:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.370843:0:14367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788746392.370846:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746392.370848:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.370849:0:14367:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788746392.370853:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788746392.370894:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14367:1875636163533440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746392.370968:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746392.371023:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533440 00000100:00100000:3.0:1788746392.371030:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533440 00000100:00100000:3.0:1788746392.371067:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746392.371076:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14367:x1875636163533440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746392.371440:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163533312:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788746392.371482:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636163533312 offset 0 length 520: 4 00000100:00100000:3.0:1788746392.371780:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14367:x1875636163533440:12345-0@lo:502:llog_process_th.0 Request processed in 704us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.371789:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746392.371834:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c27f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746392.371855:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14367:1875636163533440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746392.371882:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746392.371887:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.371889:0:14367:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788746392.371893:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000040:00080000:2.0:1788746392.372217:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788746392.372222:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:01000000:1.0:1788746392.372838:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788746392.372861:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788746392.372879:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a96f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.372904:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477401000/0xe59b64da5b30a968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a96f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746392.372912:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448410800 from 1 10000000:01000000:1.0:1788746392.372916:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746392.372949:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.372957:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.372968:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.372987:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746392.373045:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.373081:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.373151:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533568 00000100:00100000:0.0:1788746392.373157:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533568 00000100:00100000:0.0:1788746392.373208:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788746392.373217:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+9:14332:x1875636163533568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746392.373238:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746392.373252:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30a9e6 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.373273:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.373284:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.373293:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9600, rc 0) 00000100:00100000:0.0:1788746392.373338:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+10:14332:x1875636163533568:12345-0@lo:101:mount.lustre.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.373344:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746392.373623:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746392.373637:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.373645:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.374385:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533696:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788746392.374464:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.374497:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.374576:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533696 00000100:00100000:2.0:1788746392.374582:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533696 00000100:00100000:2.0:1788746392.374626:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788746392.374635:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+10:14332:x1875636163533696:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788746392.374651:0:14343:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788746392.374658:0:14343:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788746392.374729:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+10:14332:x1875636163533696:12345-0@lo:256:mount.lustre.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.374736:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746392.374888:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533696:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788746392.375719:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746392.375731:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.375741:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746392.375750:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448410800 from 1 10000000:01000000:1.0:1788746392.375753:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746392.375784:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.375792:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.375801:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.375818:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746392.375857:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.375893:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.375963:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533824 00000100:00100000:2.0:1788746392.375970:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533824 00000100:00100000:2.0:1788746392.376023:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746392.376032:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+10:14332:x1875636163533824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746392.376042:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746392.376057:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30a9f4 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.376076:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.376087:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.376096:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:2.0:1788746392.376136:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163533824:12345-0@lo:101:mount.lustre.0 Request processed in 105us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.376155:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746392.376553:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746392.376568:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746392.376577:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746392.376659:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746392.376688:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.376706:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.376802:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163533952 00000100:00100000:0.0:1788746392.376808:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163533952 00000100:00100000:0.0:1788746392.376846:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788746392.376854:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163533952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746392.377270:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163533952:12345-0@lo:501:mount.lustre.0 Request processed in 415us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.377278:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746392.377556:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163533952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746392.377591:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746392.377880:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.377907:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.378142:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534080 00000100:00100000:0.0:1788746392.378155:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534080 00000100:00100000:0.0:1788746392.378194:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746392.378310:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163534080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746392.378510:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163534080:12345-0@lo:503:mount.lustre.0 Request processed in 309us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.378517:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788746392.379260:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746392.384358:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14375:1875636163534208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746392.384479:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746392.384521:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783180 going to sleep for 11 seconds 00000100:00100000:3.0:1788746392.384779:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534208 00000100:00100000:3.0:1788746392.384787:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534208 00000100:00100000:3.0:1788746392.384835:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746392.384843:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14375:x1875636163534208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746392.385331:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14375:x1875636163534208:12345-0@lo:502:llog_process_th.0 Request processed in 486us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.385339:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746392.386143:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14375:1875636163534208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746392.386180:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746392.386191:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.386193:0:14375:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788746392.386214:0:14375:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448410800 00000020:00000080:2.0:1788746392.386217:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746392.386234:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746392.386237:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.386238:0:14375:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788746392.386241:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746392.386244:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.386245:0:14375:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788746392.386249:0:14375:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd448410800 00000020:00000080:2.0:1788746392.386251:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746392.386308:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746392.386312:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.386314:0:14375:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788746392.386316:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746392.386319:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746392.386320:0:14375:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788746392.386323:0:14375:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd448410800 00000020:00000080:2.0:1788746392.386324:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788746392.386368:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14375:1875636163534336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746392.386449:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746392.386489:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783180 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.388347:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534336 00000100:00100000:0.0:1788746392.388361:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534336 00000100:00100000:0.0:1788746392.388450:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746392.388460:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14375:x1875636163534336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746392.388703:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14375:x1875636163534336:12345-0@lo:502:llog_process_th.0 Request processed in 244us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.388711:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746392.389152:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14375:1875636163534336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788746392.389186:0:14375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746392.389193:0:14375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746392.389195:0:14375:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788746392.389213:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788746392.389471:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788746392.389491:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746392.389504:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.389514:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746392.389560:0:14332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788746392.389563:0:14332:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd448410800 10000000:01000000:0.0:1788746392.389565:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd448410800 10000000:01000000:0.0:1788746392.389569:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746392.389574:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd448410800 from 1 10000000:01000000:0.0:1788746392.389577:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746392.389608:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.389622:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.389632:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746392.389651:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746392.389694:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746392.389724:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788746392.390425:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534464 00000100:00100000:3.0:1788746392.390433:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534464 00000100:00100000:3.0:1788746392.390475:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746392.390484:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163534464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746392.390497:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746392.390513:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440030000/0xe59b64da5b30aa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa02 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.390538:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440030000/0xe59b64da5b30aa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa02 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.390549:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440030000/0xe59b64da5b30aa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa02 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.390558:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440030000, rc 0) 00000100:00100000:3.0:1788746392.390614:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163534464:12345-0@lo:101:mount.lustre.0 Request processed in 130us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.390621:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788746392.390740:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746392.390756:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa09 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746392.390766:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa09 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746392.390822:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746392.390852:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746392.390884:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.394438:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534592 00000100:00100000:2.0:1788746392.394452:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534592 00000100:00100000:2.0:1788746392.394507:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788746392.394516:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163534592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746392.394812:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163534592:12345-0@lo:501:mount.lustre.0 Request processed in 297us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.394819:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788746392.394826:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746392.394872:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746392.394916:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746392.394964:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.397321:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534720 00000100:00100000:2.0:1788746392.397334:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534720 00000100:00100000:2.0:1788746392.397382:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788746392.397390:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163534720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746392.397644:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163534720:12345-0@lo:503:mount.lustre.0 Request processed in 254us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.397652:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788746392.397805:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163534720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746392.403492:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14378:1875636163534848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746392.403572:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.403617:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534848 00000100:00100000:1.0:1788746392.403624:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534848 00000100:00100000:1.0:1788746392.403665:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788746392.403673:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14378:x1875636163534848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746392.403900:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14378:x1875636163534848:12345-0@lo:502:llog_process_th.0 Request processed in 226us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746392.403908:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788746392.403960:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45024f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746392.403981:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14378:1875636163534848:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788746392.404053:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788746392.404075:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cd445acb380) 00000020:00000080:1.0:1788746392.404095:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788746392.404165:0:14378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd448410800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788746392.404169:0:14378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd448410800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788746392.404172:0:14378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd448410800 4 00010000:00080000:1.0:1788746392.404218:0:14378:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd44ff0c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.124@tcp at head 00010000:00010000:1.0:1788746392.405879:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788746392.406581:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788746392.406616:0:14378:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788746392.406633:0:14378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe59b64da5b30aa17 00000100:00080000:0.0:1788746392.406642:0:14378:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788746392.406652:0:14378:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cd44ff0c000 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:0.0:1788746392.406687:0:14378:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd45f988e00 x1875636163534976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746392.406712:0:14378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788746392.412325:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14378:1875636163535104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746392.412413:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.415718:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163534976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746392.415793:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746392.415884:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163534976 00000100:00100000:1.0:1788746392.415892:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163534976 00000100:00100000:0.0:1788746392.420919:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44512b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.428265:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535104 00000100:00100000:0.0:1788746392.428279:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535104 00000100:00100000:0.0:1788746392.428345:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746392.428355:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14378:x1875636163535104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746392.428677:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14378:x1875636163535104:12345-0@lo:502:llog_process_th.0 Request processed in 323us (16279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746392.428685:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746392.428750:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14378:1875636163535104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788746392.428784:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788746392.429806:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788746392.429841:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788746392.429856:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa09 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.429879:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9000/0xe59b64da5b30aa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa09 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788746392.429934:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788746392.429936:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746392.429937:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746392.429939:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746392.429944:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746392.429946:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746392.429947:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746392.429948:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746392.429950:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746392.429951:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788746392.429954:0:14332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788746392.429956:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788746392.429957:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746392.429958:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746392.429959:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746392.429960:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746392.429961:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746392.429961:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746392.429962:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746392.429963:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746392.429964:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788746392.429990:0:14332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788746392.430547:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163535232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788746392.430613:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746392.430656:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c27000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746392.432692:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535232 00000100:00100000:0.0:1788746392.432706:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535232 00000100:00100000:0.0:1788746392.432757:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746392.432766:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14332:x1875636163535232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788746392.432793:0:14343:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788746392.432806:0:14343:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788746392.433476:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746392.433484:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163534976:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746392.433564:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875636163534976:12345-0@lo:38:llog_process_th.0 Request processed in 79us (17770us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788746392.433571:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746392.433618:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788746392.433625:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd44ff0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746392.433630:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788746392.433633:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163534976:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788746392.543365:0:14343:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788746392.543382:0:14343:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788746392.543419:0:14365:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788746392.543424:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788746392.543447:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543465:0:14365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543473:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543540:0:14365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543555:0:14365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 12 pid: 14344 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746392.543570:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163535360:0@lo:104: 00000100:00100000:2.0:1788746392.543635:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746392.543703:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445783600 going to sleep for 11 seconds 00000100:00100000:2.0:1788746392.543742:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535360 00000100:00100000:2.0:1788746392.543749:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535360 00000100:00100000:2.0:1788746392.543790:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746392.543799:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163535360:12345-0@lo:104: 00010000:00010000:2.0:1788746392.543811:0:14333:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543858:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788746392.543865:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163535360:12345-0@lo:104: Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.543872:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788746392.543893:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746392.543898:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543906:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:2.0:1788746392.543910:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543929:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746392.543936:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746392.543942:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746392.543965:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543972:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746392.543988:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.543995:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd477401c00/0xe59b64da5b30a9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746392.544014:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.544015:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746392.544017:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746392.544041:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163535488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788746392.544068:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746392.544379:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163535360:0@lo:104: 00010000:00010000:2.0:1788746392.544418:0:14365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746392.545013:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535488 00000100:00100000:3.0:1788746392.545021:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535488 00010000:00010000:3.0:1788746392.545045:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 13 pid: 14344 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746392.545080:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746392.545088:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+13:3317:x1875636163535488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746392.545099:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746392.545104:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 13 pid: 14344 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545113:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 13 pid: 14344 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545144:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd47d1f9600/0xe59b64da5b30a9ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30a9e6 expref: 13 pid: 14344 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545158:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545166:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788746392.545180:0:14335:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001756700s 00010000:00010000:3.0:1788746392.545184:0:14335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545191:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545209:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545216:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545221:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746392.545234:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545241:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545258:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545276:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746392.545322:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3317:x1875636163535488:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746392.545330:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746392.545363:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163535488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746392.545391:0:14365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545427:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746392.545433:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44c00/0xe59b64da5b30aa1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746392.604155:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14332:x1875636163535232:12345-0@lo:253:mount.lustre.0 Request processed in 171379us (173531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746392.604190:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746392.604612:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14332:1875636163535232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788746392.604632:0:14332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788746392.604636:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788746392.604638:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746392.604640:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746392.604640:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746392.604642:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746392.604643:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746392.604644:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746392.604646:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746392.604647:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746392.604648:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788746392.604662:0:14332:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788746392.611271:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.611542:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746392.611809:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.611938:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746392.612208:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.612464:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746392.613524:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.613644:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746392.613814:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.613971:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746392.614512:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746392.614681:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788746392.643257:0:14332:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788746392.643742:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788746392.643814:0:14388:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788746392.643819:0:14388:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788746392.643910:0:14389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788746392.643984:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788746392.645174:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788746392.645474:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788746392.646452:0:14332:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788746392.646569:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788746392.646739:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746392.647320:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788746392.647391:0:14389:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788746392.647395:0:14389:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788746392.648707:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788746392.649360:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788746392.649423:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788746392.650654:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788746392.654715:0:14332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788746392.676845:0:14332:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788746392.676888:0:14332:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb85481ce3988 00100000:10000000:3.0:1788746392.676897:0:14332:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788746392.679134:0:14332:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788746392.679150:0:14332:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788746392.679166:0:14332:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788746392.679180:0:14332:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788746393.018957:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788746393.274794:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788746393.274805:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448410800 from 6 10000000:01000000:2.0:1788746393.274812:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788746393.274873:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746393.274889:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746393.274921:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746393.274953:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163535616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788746393.275047:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746393.275157:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746393.278647:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535616 00000100:00100000:1.0:1788746393.278742:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535616 00000100:00100000:1.0:1788746393.278831:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746393.278844:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14347:x1875636163535616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746393.278867:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746393.278896:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa25 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746393.278931:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746393.278944:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746393.278972:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400600, rc 0) 00000100:00100000:1.0:1788746393.279076:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163535616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746393.279083:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746393.279268:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163535616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746393.279294:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746393.279307:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746393.279744:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163535744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788746393.279800:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746393.279842:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746393.280099:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535744 00000100:00100000:1.0:1788746393.280107:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535744 00000100:00100000:1.0:1788746393.280146:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788746393.280155:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163535744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788746393.280176:0:14343:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746393.280200:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746393.280203:0:14343:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788746393.280309:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163535744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746393.280317:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788746393.280713:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163535744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788746393.280773:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788746393.280784:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746393.280795:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746393.544271:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746394.043649:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746394.560246:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788746395.067250:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746396.098595:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746397.118063:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746397.631792:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163535872:0@lo:400:kworker.0 00000100:00100000:0.0:1788746397.631857:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788746397.631927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746397.631931:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746397.631934:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746397.631936:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746397.631939:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788746397.631942:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788746397.631945:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cd44ff0c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746397.631958:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cd44ff0c000 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746397.631988:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd450080380 x1875636163536000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746397.632082:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163536000:0@lo:38:kworker.0 00000100:00100000:1.0:1788746397.632111:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746397.634044:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163535872 00000100:00100000:2.0:1788746397.634065:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163535872 00000100:00100000:2.0:1788746397.634156:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746397.634165:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3314:x1875636163535872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746397.635333:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536000 00000100:00100000:1.0:1788746397.635343:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536000 00000100:00100000:1.0:1788746397.635377:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746397.635385:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875636163536000:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788746397.635426:0:14351:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788746397.635460:0:14351:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe59b64da5b30aa33 00000004:00100000:1.0:1788746397.635475:0:14351:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788746397.635619:0:14351:0:(import.c:65:import_set_state_nolock()) ffff9cd47ebd4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746397.635692:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875636163536000:12345-0@lo:38:kworker.0 Request processed in 306us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746397.635699:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788746397.635770:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd450080380 x1875636163536000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746397.635785:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788746397.635792:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788746397.635796:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788746397.635798:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd44ff0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788746397.635804:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875636163536000:0@lo:38:kworker.0 00000100:00100000:2.0:1788746397.636390:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3314:x1875636163535872:12345-0@lo:400:kworker.0 Request processed in 2222us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746397.636422:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788746397.639567:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163535872:0@lo:400:kworker.0 00000001:02000400:3.0:1788746397.642512:0:14631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788746398.139062:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746399.166899:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746400.187045:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788746400.668281:0:14783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed0aca080 20000000:00000080:1.0:1788746400.668299:0:14783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd445a8a800 uarg=0000000000000000 20000000:01000000:1.0:1788746400.668334:0:14783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788746400.668349:0:14783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788746400.668354:0:14783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788746400.672363:0:14784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788746400.672656:0:14783:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788746400.682820:0:14783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746400.682854:0:14783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746400.682874:0:14783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746400.682882:0:14783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746400.682928:0:14783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746400.682944:0:14783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 11 pid: 14345 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746400.682959:0:14783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14783:1875636163536128:0@lo:104: 00000100:00100000:2.0:1788746400.683025:0:14783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746400.683088:0:14783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd45f5f4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788746400.685923:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536128 00000100:00100000:1.0:1788746400.685935:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536128 00000100:00100000:1.0:1788746400.685996:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746400.686006:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14783:x1875636163536128:12345-0@lo:104: 00010000:00010000:1.0:1788746400.686023:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746400.686115:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746400.686121:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14783:x1875636163536128:12345-0@lo:104: Request processed in 118us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746400.686128:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746400.686231:0:14783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14783:1875636163536128:0@lo:104: 00010000:00010000:3.0:1788746400.686255:0:14783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686382:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746400.686389:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686425:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401600 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746400.686430:0:14338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686438:0:14338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746400.686445:0:14338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746400.686451:0:14338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788746400.686492:0:14338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686498:0:14338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746400.686520:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686543:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd477401600/0xe59b64da5b30a9f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30a9fb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686562:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746400.686564:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746400.686565:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746400.686573:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746400.686585:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163536256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746400.686624:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746400.686668:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536256 00000100:00100000:0.0:1788746400.686672:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536256 00010000:00010000:0.0:1788746400.686691:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 12 pid: 14345 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746400.686713:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746400.686719:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3314:x1875636163536256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746400.686729:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746400.686733:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 12 pid: 14345 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686742:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 12 pid: 14345 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686755:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30a9fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30a9f4 expref: 12 pid: 14345 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686767:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686784:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686798:0:14335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686805:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686811:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686818:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686822:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746400.686826:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686833:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686844:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746400.686851:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746400.686877:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:3314:x1875636163536256:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746400.686883:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746400.686909:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163536256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746400.686987:0:14783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746400.686995:0:14783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746400.687001:0:14783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30aa3a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746401.211894:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746402.234744:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788746402.427623:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788746402.427631:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448410800 from 10 10000000:01000000:3.0:1788746402.427637:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746402.427691:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746402.427734:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746402.427746:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746402.427772:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788746402.427847:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746402.427921:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746402.428078:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536384 00000100:00100000:1.0:1788746402.428086:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536384 00000100:00100000:1.0:1788746402.428145:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746402.428154:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+11:14347:x1875636163536384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746402.428168:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746402.428191:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa41 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746402.428215:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746402.428225:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746402.428233:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401c00, rc 0) 00000100:00100000:1.0:1788746402.428287:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163536384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746402.428294:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746402.428380:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746402.428395:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746402.428442:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746402.428500:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746402.428527:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746402.428559:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd455870c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746402.428650:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536512 00000100:00100000:1.0:1788746402.428654:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536512 00000100:00100000:1.0:1788746402.428686:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788746402.428693:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163536512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746402.428942:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163536512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746402.428949:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746402.429029:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746402.429061:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746402.429101:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746402.429124:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794900 going to sleep for 11 seconds 00000100:00100000:3.0:1788746402.429175:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536640 00000100:00100000:3.0:1788746402.429190:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536640 00000100:00100000:3.0:1788746402.429211:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788746402.429217:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163536640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746402.429384:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:14347:x1875636163536640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746402.429391:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746402.429500:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163536640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788746402.430438:0:14845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788746402.430810:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788746402.430844:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746402.430854:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746402.430865:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788746402.747044:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746402.747052:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746402.747054:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746402.747057:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788746402.747088:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163536768:0@lo:400:kworker.0 00000100:00100000:1.0:1788746402.747156:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746402.747217:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746402.747223:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163536896:0@lo:400:kworker.0 00000100:00100000:1.0:1788746402.747248:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746402.747281:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536768 00000100:00100000:1.0:1788746402.747288:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536768 00000100:00100000:0.0:1788746402.748443:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746392/real 1788746392] req@ffff9cd48001ca80 x1875636163533312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746402 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746402.748466:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd48001ca80 x1875636163533312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746402 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746402.748478:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746392/real 1788746392] req@ffff9cd344b55180 x1875636163533184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746402 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746402.748489:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd344b55180 x1875636163533184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746402 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788746402.748503:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746402.748533:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788746402.748849:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746402.748861:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3316:x1875636163536768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746402.748932:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:3316:x1875636163536768:12345-0@lo:400:kworker.0 Request processed in 73us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746402.748952:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746402.748989:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163536896 00000100:00100000:1.0:1788746402.748995:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163536896 00000100:00100000:1.0:1788746402.749021:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746402.749027:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163536896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746402.749058:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163536896:12345-0@lo:400:kworker.0 Request processed in 32us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746402.749063:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788746402.749100:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd450081500 x1875636163536896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746402.749113:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163536896:0@lo:400:kworker.0 00000100:00100000:1.0:1788746402.749122:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163536768:0@lo:400:kworker.0 00000100:00100000:0.0:1788746402.749196:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163533312:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788746402.749203:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746402.749210:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788746402.749213:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163533184:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788746402.749237:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746402.749247:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788746402.749249:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746402.749254:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1788746402.749258:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788746402.749265:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cd3452a7800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:0.0:1788746402.749292:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd45f988380 x1875636163537024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746402.749316:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746402.749319:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746402.749320:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746402.749323:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1788746402.749326:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788746402.749330:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd4521dd800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:0.0:1788746402.749342:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd45f98aa00 x1875636163537152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746402.749783:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163537024:0@lo:8:kworker.0 00000400:00000100:1.0:1788746402.749813:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636163537024 offset 0 length 520: 4 00000100:00100000:1.0:1788746402.749838:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163537152:0@lo:8:kworker.0 00000400:00000100:1.0:1788746402.749853:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636163537152 offset 0 length 520: 4 00010000:00010000:3.0:1788746403.259304:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746404.282699:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746404.796792:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788746405.306817:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788746405.971029:0:15032:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746405.971033:0:15032:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788746405.971159:0:15032:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cd476f8a000 00000020:01000004:3.0:1788746405.971183:0:15032:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788746405.971195:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788746405.971208:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cd45fbbb380) 00000020:00000080:3.0:1788746405.971222:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788746405.998690:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788746405.999005:0:15032:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788746406.001050:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788746406.001301:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788746406.001529:0:15032:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788746406.001857:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 541: rc = 0 00100000:10000000:3.0:1788746406.001961:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 541: rc = 0 00100000:10000000:3.0:1788746406.002037:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 541: rc = 0 00100000:10000000:2.0:1788746406.004194:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 732: rc = 0 00100000:10000000:2.0:1788746406.004886:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 732: rc = 0 00100000:10000000:2.0:1788746406.005215:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 732: rc = 0 00100000:10000000:2.0:1788746406.006142:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 732: rc = 0 00100000:10000000:2.0:1788746406.006461:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 732: rc = 0 00100000:10000000:2.0:1788746406.006911:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 732: rc = 0 00000020:00000080:2.0:1788746406.009580:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788746406.009592:0:15032:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746406.009603:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe59b64da5b30aa56 00000020:01000004:2.0:1788746406.009667:0:15032:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788746406.009690:0:15032:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746406.009694:0:15032:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746406.009700:0:15032:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788746406.009705:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788746406.009723:0:15032:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cd445d53380) 00000020:00000080:2.0:1788746406.009735:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788746406.010975:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746406.011156:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746406.011162:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788746406.011759:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788746406.011767:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788746406.012153:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788746406.012162:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788746406.014480:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746406.014653:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788746406.014660:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788746406.021467:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788746406.021480:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788746406.041746:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746406.042063:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746406.042070:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788746406.046322:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788746406.046338:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788746406.047317:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788746406.047325:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788746406.053701:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746406.053901:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788746406.053907:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788746406.055059:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788746406.055068:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788746406.091072:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746406.091296:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788746406.091302:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788746406.094904:0:15032:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788746406.094917:0:15032:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788746406.095742:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788746406.095768:0:15032:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788746406.095774:0:15032:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788746406.111020:0:15032:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788746406.111058:0:15032:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.124@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788746406.111062:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788746406.111064:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788746406.111065:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746406.111066:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746406.111067:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746406.111069:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746406.111070:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746406.111072:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746406.111073:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746406.111081:0:15032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788746406.111083:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746406.111084:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788746406.111085:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746406.111086:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746406.111087:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746406.111088:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746406.111089:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746406.111090:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746406.111090:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746406.111116:0:15032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788746406.111135:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788746406.111221:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746406.111287:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794600 going to sleep for 11 seconds 00000100:00100000:2.0:1788746406.111437:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537280 00000100:00100000:2.0:1788746406.111445:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537280 00000100:00100000:2.0:1788746406.111493:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788746406.111501:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:15032:x1875636163537280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788746406.111529:0:14343:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788746406.111532:0:14343:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788746406.111536:0:14343:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788746406.119514:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:15032:x1875636163537280:12345-0@lo:253:mount.lustre.0 Request processed in 8004us (8283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746406.119527:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746406.121542:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746406.121558:0:15032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788746406.121561:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746406.121563:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788746406.121564:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746406.121565:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746406.121567:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746406.121568:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746406.121569:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746406.121571:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746406.121572:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788746406.121686:0:15032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd476f8a000 from lustre-OST0000 10000000:01000000:1.0:1788746406.121716:0:15032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788746406.121719:0:15032:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788746406.121735:0:15032:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cd447514d40 local copy 00010000:00010000:1.0:1788746406.121744:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746406.121975:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746406.122024:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746406.122121:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746406.122490:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537408 00000100:00100000:2.0:1788746406.122497:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537408 00000100:00100000:2.0:1788746406.122575:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788746406.122584:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:15032:x1875636163537408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746406.122746:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:15032:x1875636163537408:12345-0@lo:501:mount.lustre.0 Request processed in 163us (721us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746406.122752:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788746406.122834:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537408:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788746406.122848:0:15032:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788746406.122990:0:15032:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788746406.122999:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.123008:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746406.123033:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd476f8a000 10000000:01000000:3.0:1788746406.123037:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788746406.123041:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cd447514d40 10000000:01000000:3.0:1788746406.123043:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788746406.123047:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cd447514d40 from 1 10000000:01000000:3.0:1788746406.123049:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788746406.123075:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.123083:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.123115:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746406.123132:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746406.123182:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.123617:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.123680:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537536 00000100:00100000:1.0:1788746406.123686:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537536 00000100:00100000:1.0:1788746406.123712:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746406.123720:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+12:15032:x1875636163537536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746406.123729:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746406.123744:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400c00/0xe59b64da5b30aa6b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa64 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.123766:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400c00/0xe59b64da5b30aa6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa64 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.123776:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400c00/0xe59b64da5b30aa6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa64 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.123785:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400c00, rc 0) 00000100:00100000:1.0:1788746406.123826:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+13:15032:x1875636163537536:12345-0@lo:101:mount.lustre.0 Request processed in 107us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.123833:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788746406.123905:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746406.123918:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa6b expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.123926:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa6b expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746406.123940:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788746406.123957:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa6b expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.123964:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440031a00/0xe59b64da5b30aa64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa6b expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746406.123970:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788746406.123974:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788746406.123978:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788746406.123980:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788746406.123994:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.124001:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.124019:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746406.124033:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746406.124060:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.124072:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.124130:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537664 00000100:00100000:1.0:1788746406.124135:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537664 00000100:00100000:1.0:1788746406.124297:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788746406.124304:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+13:15032:x1875636163537664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746406.124320:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746406.124328:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400a00/0xe59b64da5b30aa79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa72 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.124344:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400a00/0xe59b64da5b30aa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa72 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.124352:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400a00/0xe59b64da5b30aa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa72 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.124360:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400a00, rc 0) 00000100:00100000:1.0:1788746406.124479:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163537664:12345-0@lo:101:mount.lustre.0 Request processed in 175us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.124485:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746406.124771:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746406.124783:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa79 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.124791:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa79 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746406.125791:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788746406.126925:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746406.127885:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788746406.127942:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788746406.127977:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788746406.128029:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788746406.128065:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788746406.128100:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788746406.128375:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788746406.128384:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788746406.128573:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746406.128630:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.128758:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44876f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.132625:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537792 00000100:00100000:1.0:1788746406.132639:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537792 00000100:00100000:1.0:1788746406.132732:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788746406.132743:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163537792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746406.133433:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163537792:12345-0@lo:501:mount.lustre.0 Request processed in 691us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.133442:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788746406.135679:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746406.135742:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746406.135811:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.135939:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.136003:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163537920 00000100:00100000:1.0:1788746406.136010:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163537920 00000100:00100000:1.0:1788746406.136058:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788746406.136066:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163537920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746406.136625:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163537920:12345-0@lo:503:mount.lustre.0 Request processed in 559us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.136641:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788746406.136737:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163537920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788746406.137592:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746406.137668:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.137713:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.137787:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788746406.138215:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538048 00000100:00100000:2.0:1788746406.138222:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538048 00000100:00100000:2.0:1788746406.138264:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788746406.138281:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163538048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746406.139089:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163538048:12345-0@lo:502:mount.lustre.0 Request processed in 807us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746406.139105:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788746406.139289:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746406.139557:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788746406.139612:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788746406.139644:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788746406.139688:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788746406.139722:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788746406.139750:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788746406.139792:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788746406.139832:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788746406.139863:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788746406.139919:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788746406.139958:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788746406.140004:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788746406.140039:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.140081:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.140240:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746406.140496:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538176 00000100:00100000:0.0:1788746406.140503:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538176 00000100:00100000:0.0:1788746406.140574:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788746406.140583:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163538176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746406.140761:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163538176:12345-0@lo:502:mount.lustre.0 Request processed in 180us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746406.140769:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788746406.140841:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746406.140924:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788746406.140934:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788746406.143923:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788746406.143933:0:15046:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788746406.143939:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746406.143941:0:15046:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788746406.143946:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746406.143960:0:15046:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cd45fbbcd40) 00000020:00000080:3.0:1788746406.143982:0:15046:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788746406.143988:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788746406.144043:0:15046:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd476f8a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788746406.144049:0:15046:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788746406.144055:0:15046:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe59b64da5b30aa87 00010000:00010000:3.0:1788746406.152982:0:15046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788746406.154068:0:15046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788746406.156121:0:15046:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788746406.174826:0:15046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788746406.174836:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746406.174853:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174855:0:15046:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788746406.174857:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788746406.174860:0:15046:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788746406.174861:0:15046:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788746406.174863:0:15046:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788746406.174864:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788746406.174867:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174868:0:15046:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788746406.174870:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746406.174873:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174875:0:15046:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788746406.174878:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788746406.174879:0:15046:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788746406.174881:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746406.174884:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174885:0:15046:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788746406.174887:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746406.174888:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174889:0:15046:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788746406.174892:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788746406.174957:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746406.174961:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746406.174962:0:15046:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788746406.174964:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788746406.175189:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788746406.175216:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788746406.175242:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa79 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.175254:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030c00/0xe59b64da5b30aa72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa79 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746406.175263:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd476f8a000 from 1 10000000:01000000:2.0:1788746406.175265:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746406.175300:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.175308:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.175319:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746406.175345:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746406.175443:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.175484:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746406.175579:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538304 00000100:00100000:0.0:1788746406.175588:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538304 00000100:00100000:0.0:1788746406.175627:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788746406.175637:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+14:15032:x1875636163538304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746406.175651:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746406.175666:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa8e expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.175691:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.175711:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.175719:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8200, rc 0) 00000100:00100000:0.0:1788746406.175761:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538304:12345-0@lo:101:mount.lustre.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746406.175768:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788746406.175851:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746406.175876:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.175884:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746406.176762:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788746406.181463:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746406.181852:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788746406.181903:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788746406.181966:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788746406.181975:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788746406.182122:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746406.182198:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.182348:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd442bf9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.182514:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538432 00000100:00100000:1.0:1788746406.182521:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538432 00000100:00100000:1.0:1788746406.182564:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788746406.182573:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746406.182769:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538432:12345-0@lo:501:mount.lustre.0 Request processed in 195us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.182777:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788746406.182861:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746406.182904:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746406.182945:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.182974:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746406.183154:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538560 00000100:00100000:0.0:1788746406.183161:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538560 00000100:00100000:0.0:1788746406.183202:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788746406.183218:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746406.183367:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538560:12345-0@lo:503:mount.lustre.0 Request processed in 158us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746406.183373:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746406.183558:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788746406.183991:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746406.184061:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.184100:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.184134:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.184481:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538688 00000100:00100000:1.0:1788746406.184488:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538688 00000100:00100000:1.0:1788746406.184515:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788746406.184522:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746406.184680:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538688:12345-0@lo:502:mount.lustre.0 Request processed in 157us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.184688:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746406.184879:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746406.185107:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788746406.185154:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788746406.185478:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788746406.185522:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788746406.185572:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788746406.185619:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788746406.185655:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788746406.185688:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788746406.185722:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.185771:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.186070:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746406.186318:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538816 00000100:00100000:3.0:1788746406.186324:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538816 00000100:00100000:3.0:1788746406.186383:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788746406.186391:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.186596:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538816:12345-0@lo:502:mount.lustre.0 Request processed in 205us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746406.186610:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746406.186755:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746406.186858:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788746406.186870:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788746406.188120:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746406.188130:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188133:0:15050:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788746406.188139:0:15050:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd476f8a000 00000020:00000080:2.0:1788746406.188142:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746406.188148:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746406.188150:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188151:0:15050:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788746406.188154:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746406.188156:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188157:0:15050:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788746406.188161:0:15050:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd476f8a000 00000020:00000080:2.0:1788746406.188162:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746406.188235:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746406.188238:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188240:0:15050:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788746406.188242:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746406.188250:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188252:0:15050:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788746406.188256:0:15050:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd476f8a000 00000020:00000080:2.0:1788746406.188258:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746406.188297:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746406.188300:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746406.188302:0:15050:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788746406.188305:0:15050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788746406.189697:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788746406.189726:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746406.189750:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.189763:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746406.189814:0:15032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788746406.189817:0:15032:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd476f8a000 10000000:01000000:3.0:1788746406.189820:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd476f8a000 10000000:01000000:3.0:1788746406.189824:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788746406.189830:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd476f8a000 from 1 10000000:01000000:3.0:1788746406.189832:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788746406.189865:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.189874:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.189884:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746406.189906:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746406.189965:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.190004:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746406.190025:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163538944 00000100:00100000:3.0:1788746406.190032:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163538944 00000100:00100000:3.0:1788746406.190084:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788746406.190092:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163538944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746406.190104:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746406.190116:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd440031e00/0xe59b64da5b30aaa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aa9c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.190137:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031e00/0xe59b64da5b30aaa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aa9c expref: 16 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.190147:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd440031e00/0xe59b64da5b30aaa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa9c expref: 16 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.190154:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031e00, rc 0) 00000100:00100000:3.0:1788746406.190203:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163538944:12345-0@lo:101:mount.lustre.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746406.190219:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788746406.190260:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163538944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746406.190273:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aaa3 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746406.190281:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aaa3 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746406.196808:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788746406.197188:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746406.197497:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788746406.197543:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788746406.197580:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788746406.197633:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788746406.197682:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788746406.197734:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788746406.197771:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788746406.197808:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788746406.197861:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788746406.197915:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788746406.197954:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788746406.198007:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788746406.198044:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788746406.198078:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788746406.198132:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788746406.198187:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788746406.198224:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788746406.198283:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788746406.198322:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788746406.198357:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788746406.198432:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788746406.198471:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788746406.198506:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788746406.198554:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788746406.198593:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788746406.198646:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788746406.198712:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788746406.198773:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788746406.198855:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788746406.198864:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788746406.198960:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746406.199023:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.199072:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.200013:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539072 00000100:00100000:1.0:1788746406.200022:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539072 00000100:00100000:1.0:1788746406.200074:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746406.200084:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746406.200350:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539072:12345-0@lo:501:mount.lustre.0 Request processed in 267us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.200358:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788746406.212129:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746406.212203:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746406.212286:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.212326:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.213010:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539200 00000100:00100000:1.0:1788746406.213018:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539200 00000100:00100000:1.0:1788746406.213157:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788746406.213178:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746406.213385:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539200:12345-0@lo:503:mount.lustre.0 Request processed in 219us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.213392:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788746406.213894:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788746406.214584:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746406.214673:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746406.214727:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746406.214762:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4773d1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788746406.215160:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539328 00000100:00100000:2.0:1788746406.215177:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539328 00000100:00100000:2.0:1788746406.215223:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746406.215232:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746406.215459:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539328:12345-0@lo:502:mount.lustre.0 Request processed in 226us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746406.215466:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746406.217865:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746406.218151:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788746406.218232:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788746406.218268:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788746406.218314:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788746406.218348:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788746406.218395:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788746406.218777:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788746406.218813:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788746406.218865:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788746406.218902:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788746406.218937:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788746406.218978:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788746406.219009:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788746406.219057:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788746406.222480:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788746406.222584:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788746406.222624:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788746406.222677:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788746406.222716:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788746406.222752:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788746406.222799:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788746406.222832:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788746406.222864:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788746406.222912:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788746406.222950:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788746406.222986:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788746406.223070:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788746406.223112:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788746406.223148:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788746406.225468:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788746406.225547:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788746406.225585:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788746406.225618:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788746406.225668:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788746406.225704:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788746406.225753:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788746406.225789:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788746406.225825:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788746406.225875:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788746406.225910:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788746406.225958:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746406.226042:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.226086:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4454bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.226181:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539456 00000100:00100000:1.0:1788746406.226188:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539456 00000100:00100000:1.0:1788746406.226298:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788746406.226309:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746406.226552:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539456:12345-0@lo:502:mount.lustre.0 Request processed in 244us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.226560:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788746406.228581:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746406.231966:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788746406.231998:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788746406.239910:0:15055:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788746406.239926:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cd445accd40) 00000020:00000080:1.0:1788746406.239948:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788746406.240026:0:15055:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd476f8a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788746406.240030:0:15055:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd476f8a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788746406.240032:0:15055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd476f8a000 3 00010000:00080000:1.0:1788746406.240060:0:15055:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd346e5d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.124@tcp at head 00010000:00010000:1.0:1788746406.242291:0:15055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788746406.242515:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788746406.242549:0:15055:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788746406.242560:0:15055:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe59b64da5b30aab1 00000100:00080000:1.0:1788746406.242570:0:15055:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746406.242580:0:15055:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cd346e5d000 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746406.242615:0:15055:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd450081500 x1875636163539584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746406.242655:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163539584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746406.242732:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746406.242803:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539584 00000100:00100000:1.0:1788746406.242809:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539584 00000100:00100000:1.0:1788746406.242838:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746406.242844:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1875636163539584:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788746406.242865:0:14350:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1788746406.242892:0:14350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe59b64da5b30aab8 00000004:00100000:1.0:1788746406.242905:0:14350:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788746406.242932:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9cd346e58000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746406.242976:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875636163539584:12345-0@lo:38:llog_process_th.0 Request processed in 130us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.242982:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788746406.243053:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd450081500 x1875636163539584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746406.243063:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788746406.243070:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788746406.243076:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788746406.243080:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788746406.243082:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd346e5d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788746406.243088:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875636163539584:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788746406.243105:0:15055:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788746406.244021:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788746406.244128:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788746406.244180:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788746406.244204:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aaa3 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.244215:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440031c00/0xe59b64da5b30aa9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aaa3 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788746406.244254:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788746406.244256:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788746406.244258:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746406.244259:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746406.244260:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746406.244261:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746406.244263:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746406.244264:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746406.244266:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788746406.244269:0:15032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788746406.244271:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788746406.244272:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788746406.244274:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746406.244275:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746406.244276:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746406.244277:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746406.244278:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746406.244278:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746406.244279:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788746406.244301:0:15032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788746406.244316:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788746406.244376:0:15032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.244434:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4454bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.244549:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539712 00000100:00100000:1.0:1788746406.244555:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539712 00000100:00100000:1.0:1788746406.244597:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788746406.244606:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15032:x1875636163539712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788746406.244635:0:14344:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788746406.244647:0:14344:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788746406.245459:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746406.245466:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746406.245469:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746406.245472:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788746406.245575:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163539840:0@lo:400:kworker.0 00000100:00100000:1.0:1788746406.245620:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746406.245700:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539840 00000100:00100000:0.0:1788746406.245705:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539840 00000100:00100000:0.0:1788746406.245744:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746406.245751:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163539840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746406.245800:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163539840:12345-0@lo:400:kworker.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746406.245818:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788746406.245862:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cd45f988a80 x1875636163539840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746406.245875:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163539840:0@lo:400:kworker.0 20000000:01000000:1.0:1788746406.281913:0:14344:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788746406.281939:0:14344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788746406.282510:0:14365:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788746406.282516:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788746406.282540:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.282576:0:14365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 16 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.282585:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.282623:0:14365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 16 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.282638:0:14365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 16 pid: 14344 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746406.282652:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163539968:0@lo:104: 00000100:00100000:2.0:1788746406.282707:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746406.282756:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4454bd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746406.283027:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163539968 00000100:00100000:1.0:1788746406.283036:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163539968 00000100:00100000:1.0:1788746406.283095:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746406.283105:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163539968:12345-0@lo:104: 00010000:00010000:1.0:1788746406.283120:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746406.283194:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746406.283394:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163539968:12345-0@lo:104: Request processed in 291us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.283425:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746406.283632:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163539968:0@lo:104: 00010000:00010000:3.0:1788746406.283653:0:14365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.283860:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746406.283867:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.283876:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:0.0:1788746406.283880:0:14338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.283888:0:14338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746406.283896:0:14338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746406.283902:0:14338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746406.283945:0:14338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.283952:0:14338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746406.283983:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.283991:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30aa25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa2c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284021:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746406.284024:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746406.284026:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746406.284034:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746406.284047:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163540096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746406.284090:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746406.284134:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540096 00000100:00100000:0.0:1788746406.284576:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540096 00010000:00010000:0.0:1788746406.284602:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 17 pid: 14344 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746406.284638:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746406.284648:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:3314:x1875636163540096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746406.284659:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746406.284664:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 17 pid: 14344 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284673:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 17 pid: 14344 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284686:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477400600/0xe59b64da5b30aa2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30aa25 expref: 17 pid: 14344 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284701:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284709:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788746406.284735:0:14337:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002219580s 00010000:00010000:0.0:1788746406.284740:0:14337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284746:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284752:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284759:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284764:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746406.284767:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284775:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284798:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746406.284807:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746406.284847:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3314:x1875636163540096:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746406.284854:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746406.285093:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163540096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746406.285366:0:14365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.285377:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746406.285383:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f44a00/0xe59b64da5b30aabf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746406.295020:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:15032:x1875636163539712:12345-0@lo:253:mount.lustre.0 Request processed in 50407us (50634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746406.295044:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788746406.295155:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15032:1875636163539712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788746406.295184:0:15032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788746406.295187:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788746406.295189:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788746406.295191:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746406.295205:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746406.295206:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746406.295207:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746406.295208:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746406.295210:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746406.295212:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788746406.295228:0:15032:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788746406.299990:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746406.301580:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746406.301768:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746406.301914:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788746406.302779:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788746406.303047:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788746406.303824:0:15032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788746406.334220:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788746406.410253:0:15032:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788746406.410262:0:15032:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788746406.410293:0:15032:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788746406.410354:0:15032:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788746406.410365:0:15032:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788746406.410392:0:15032:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788746407.355871:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788746408.253344:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746408.253351:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448410800 from 7 10000000:01000000:0.0:1788746408.253362:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746408.253427:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746408.253439:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746408.253452:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746408.253476:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163540224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746408.253534:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746408.253596:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444666c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746408.253656:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540224 00000100:00100000:1.0:1788746408.253665:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540224 00000100:00100000:1.0:1788746408.253718:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788746408.253727:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+15:14347:x1875636163540224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746408.253740:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746408.253753:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30aac6 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746408.253782:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746408.253793:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746408.253803:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400400, rc 0) 00000100:00100000:1.0:1788746408.253840:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:14347:x1875636163540224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746408.253847:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788746408.253891:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163540224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746408.253906:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746408.253914:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746408.253959:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163540352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788746408.253986:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746408.253998:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746408.254009:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540352 00000100:00100000:1.0:1788746408.254012:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540352 00000100:00100000:1.0:1788746408.254030:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788746408.254035:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:14347:x1875636163540352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788746408.254046:0:14344:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746408.254059:0:14344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746408.254065:0:14344:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788746408.254126:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:14347:x1875636163540352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746408.254134:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788746408.254186:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163540352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788746408.254232:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746408.254238:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746408.254246:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746408.379501:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746409.404092:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746410.430253:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746411.450538:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746411.450545:0:14305:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746411.450548:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746411.450551:0:14305:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746411.450638:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163540608:0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.450698:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746411.450749:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746411.450755:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163540480:0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.450782:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746411.450811:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.450974:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788746411.451011:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746411.451026:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540608 00000100:00100000:0.0:1788746411.451033:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540608 00000100:00100000:0.0:1788746411.451083:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540736 00000100:00100000:0.0:1788746411.451087:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540736 00000100:00100000:0.0:1788746411.451111:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746411.451117:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163540608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.451251:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163540608:12345-0@lo:400:kworker.0 Request processed in 133us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746411.451259:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746411.451277:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746411.451283:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.451315:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163540736:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746411.451322:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746411.451340:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540480 00000100:00100000:0.0:1788746411.451344:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540480 00000100:00100000:0.0:1788746411.451364:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788746411.451370:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3317:x1875636163540480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.451483:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3317:x1875636163540480:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746411.451490:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788746411.451529:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788746411.451555:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd45f988700 x1875636163540736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746411.451569:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788746411.451594:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163540480:0@lo:400:kworker.0 00010000:00080000:0.0:1788746411.451603:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd45f98b800 x1875636163540608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746411.451624:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163540608:0@lo:400:kworker.0 00010000:00010000:3.0:1788746412.480510:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788746413.133793:0:15398:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788746413.498530:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746414.014060:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746414.522627:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746415.547501:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746416.573067:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746416.581761:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746416.581768:0:14305:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746416.581771:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746416.581775:0:14305:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746416.581812:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746416.581831:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163540992:0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.581897:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746416.581969:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540992 00000100:00100000:0.0:1788746416.581977:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540992 00000100:00100000:0.0:1788746416.582019:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746416.582239:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163540992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.582302:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163540992:12345-0@lo:400:kworker.0 Request processed in 56us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746416.582309:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788746416.582349:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd45f98a300 x1875636163540992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746416.582362:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163540992:0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.582394:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163541120:0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.582444:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746416.583057:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746416.583072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163540864:0@lo:400:kworker.0 00000100:00100000:1.0:1788746416.583116:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746416.583174:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541120 00000100:00100000:1.0:1788746416.583180:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541120 00000100:00100000:1.0:1788746416.583222:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746416.583230:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163541120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746416.583275:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875636163541120:12345-0@lo:400:kworker.0 Request processed in 45us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746416.583282:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788746416.583311:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788746416.583337:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd45f98a300 x1875636163541120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746416.583350:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875636163541120:0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.583675:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163540864 00000100:00100000:0.0:1788746416.583680:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163540864 00000100:00100000:0.0:1788746416.583718:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788746416.583726:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3314:x1875636163540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746416.583785:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3314:x1875636163540864:12345-0@lo:400:kworker.0 Request processed in 59us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746416.583792:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788746416.583917:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163540864:0@lo:400:kworker.0 00000100:00100000:3.0:1788746417.536350:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746402/real 1788746402] req@ffff9cd45f988380 x1875636163537024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746417.536377:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd45f988380 x1875636163537024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746417.536388:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746402/real 1788746402] req@ffff9cd45f98aa00 x1875636163537152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746417.537197:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cd45f98aa00 x1875636163537152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788746417.537218:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746417.539051:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788746417.539060:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163537024:0@lo:8:kworker.0 00000100:00080000:3.0:1788746417.539070:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746417.542358:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746417.542365:0:14305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788746417.542368:0:14305:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746417.542376:0:14305:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1788746417.542381:0:14305:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788746417.542392:0:14305:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cd3452a7800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746417.542428:0:14305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd450081f80 x1875636163541376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746417.542441:0:14305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746417.542444:0:14305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788746417.542446:0:14305:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746417.542449:0:14305:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1788746417.542452:0:14305:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788746417.542456:0:14305:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd4521dd800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:1.0:1788746417.542468:0:14305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd450083800 x1875636163541504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746417.542520:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163541248:0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.542582:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746417.542630:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746417.542637:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163541632:0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.542663:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746417.542818:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163541760:0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.542846:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746417.542879:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541248 00000100:00100000:1.0:1788746417.542898:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541248 00000100:00100000:1.0:1788746417.542941:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788746417.542949:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3314:x1875636163541248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.542993:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:3314:x1875636163541248:12345-0@lo:400:kworker.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746417.543266:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788746417.543299:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541632 00000100:00100000:1.0:1788746417.543302:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541632 00000100:00100000:1.0:1788746417.543325:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541760 00000100:00100000:1.0:1788746417.543328:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541760 00000100:00100000:1.0:1788746417.543341:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746417.543346:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163541632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.543375:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163541632:12345-0@lo:400:kworker.0 Request processed in 29us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746417.543380:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746417.543389:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746417.543393:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163541760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.543435:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163541760:12345-0@lo:400:kworker.0 Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746417.543441:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788746417.543476:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd450083100 x1875636163541760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746417.543488:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163541760:0@lo:400:kworker.0 00010000:00080000:1.0:1788746417.543511:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd450081c00 x1875636163541632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746417.543519:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163541632:0@lo:400:kworker.0 00000100:00100000:1.0:1788746417.543536:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163541248:0@lo:400:kworker.0 00000100:00080000:3.0:1788746417.547147:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788746417.547160:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163537152:0@lo:8:kworker.0 00000100:00100000:3.0:1788746417.547243:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163541376:0@lo:8:kworker.0 00000100:00100000:3.0:1788746417.547321:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746417.547365:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163541504:0@lo:8:kworker.0 00000100:00100000:3.0:1788746417.547390:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746417.547457:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541376 00000100:00100000:3.0:1788746417.547465:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541376 00000100:00100000:3.0:1788746417.547490:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541504 00000100:00100000:3.0:1788746417.547492:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541504 00000100:00100000:3.0:1788746417.547505:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746417.547512:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875636163541376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788746417.547540:0:15033:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1788746417.547568:0:15033:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30aad4 00002000:00100000:3.0:1788746417.547581:0:15033:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cd44eea2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788746417.547585:0:15033:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788746417.547587:0:15033:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788746417.547919:0:15033:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788746417.547943:0:15033:0:(import.c:65:import_set_state_nolock()) ffff9cd44eea3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746417.547996:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875636163541376:12345-0@lo:8:kworker.0 Request processed in 483us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746417.548003:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746417.548021:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746417.548038:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875636163541504:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788746417.548048:0:15033:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746417.548076:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875636163541504:12345-0@lo:8:kworker.0 Request processed in 38us (686us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746417.548082:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788746417.548133:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd450081f80 x1875636163541376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746417.548143:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746417.548151:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788746417.548159:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788746417.548164:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788746417.548167:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd3452a7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788746417.548190:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788746417.548195:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163541376:0@lo:8:kworker.0 00000100:00080000:3.0:1788746417.548207:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746417.548211:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788746417.548214:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163541504:0@lo:8:kworker.0 00000004:00080000:3.0:1788746417.548252:0:14371:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788746417.548493:0:14371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491953092875ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788746417.551235:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163541888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746417.551297:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788746417.551352:0:14372:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788746417.551375:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14372:1875636163542016:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788746417.551423:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746417.551440:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444666d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746417.551464:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163541888 00000100:00100000:1.0:1788746417.551471:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163541888 00000100:00100000:1.0:1788746417.551515:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746417.551523:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875636163541888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746417.551551:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746417.551943:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542016 00000100:00100000:2.0:1788746417.551948:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542016 00000100:00100000:2.0:1788746417.551976:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788746417.551982:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14372:x1875636163542016:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788746417.554262:0:15033:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788746417.554272:0:15033:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788746417.554277:0:15033:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1788746417.564732:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163541888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13197us (13423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746417.564749:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788746417.564893:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746417.568276:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd450081880 x1875636163541888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746417.568303:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163541888:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788746417.587598:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746417.587622:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.587639:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1788746417.587644:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746417.587651:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.587668:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.587678:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.587686:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.587710:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.588156:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.588164:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.588173:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.588177:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.588187:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.588205:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.588213:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dea527d7/0xe59b64da5b30aadb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.588232:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.588234:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.588236:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788746417.592525:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746417.592540:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.592556:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1788746417.592561:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746417.592567:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.592580:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.592599:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.594531:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.595126:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.595173:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.598204:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.598217:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.598231:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.598237:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.598258:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.598284:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.598293:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae1ec3c/0xe59b64da5b30aae2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.598315:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.598317:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.598320:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788746417.599340:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746417.599350:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.599363:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1788746417.599367:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746417.599372:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.599384:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.599394:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.599501:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.600661:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788746417.601364:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746417.601373:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.601387:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1788746417.601392:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746417.601417:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.601432:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.601442:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.601451:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.606964:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788746417.609456:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788746417.609468:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.609480:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.609485:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.609507:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611387:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611438:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f061da/0xe59b64da5b30aae9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611471:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.611477:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611485:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.611489:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611499:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611510:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611517:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c49d92d/0xe59b64da5b30aaf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.611563:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.611565:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.611567:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.611843:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.611846:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.611848:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.614888:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.614901:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.614917:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.614922:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.614929:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615099:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615113:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615131:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615150:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.615164:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.615175:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615184:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.615188:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615198:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615214:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615222:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30aaf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.615238:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.615240:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.615241:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.621629:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.621643:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.621660:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.621664:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.621670:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.622030:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.622109:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.622127:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.622147:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746417.624495:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.624507:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624523:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.624527:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.624533:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624556:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624566:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624585:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624604:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788746417.624616:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788746417.624622:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624630:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.624635:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624645:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624660:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624668:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30aafe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624692:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.624696:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624711:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.624715:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624722:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624733:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624740:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.624752:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.624754:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.624755:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.625184:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.625190:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625200:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.625203:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.625207:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625217:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625230:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625237:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625250:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.625257:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.625261:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625268:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.625354:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625362:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625372:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625379:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.625392:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.625433:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.625435:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.626361:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.626371:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626383:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.626388:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.626393:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626429:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626437:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626444:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626460:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.626471:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.626475:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626482:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.626487:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626506:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626519:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626527:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.626769:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.626772:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.626774:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.627340:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.627346:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627356:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.627360:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.627364:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627373:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627380:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627393:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627426:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746417.627434:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746417.627438:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627445:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746417.627448:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627455:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627466:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627474:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.627489:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.627491:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.627494:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.628229:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.628243:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.628253:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.628257:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.628262:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629292:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629308:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629316:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629337:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746417.629881:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.629888:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629900:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.629904:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.629909:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629920:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629935:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629943:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.629951:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788746417.630110:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746417.630128:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630139:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.630144:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630154:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630175:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630190:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000449e33b7/0xe59b64da5b30ab21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630212:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746417.630216:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630223:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.630227:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630236:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630248:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630256:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003492875/0xe59b64da5b30ab28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.630275:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.630277:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.630280:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.630325:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.630331:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.630339:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.630342:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.630346:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.630355:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.630362:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.630369:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.630395:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746417.631622:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.631631:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.631643:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.631648:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.631652:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.631663:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.631673:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.631738:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.631749:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788746417.632612:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746417.632621:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788746417.633146:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788746417.633520:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.633528:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633621:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.633626:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633637:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633656:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633663:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd41ca17/0xe59b64da5b30ab2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633681:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746417.633685:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633692:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.633695:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633703:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633713:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633727:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.633740:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.633742:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.633744:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746417.634010:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.634023:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.634029:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.634041:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.634049:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.634056:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.634631:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746417.634866:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746417.634873:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.634882:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.634887:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.634896:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.634911:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.634918:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.634937:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.634939:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.634941:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.634988:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746417.635919:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.635928:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.635940:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.635944:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.635948:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.635959:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.635967:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.635974:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.635995:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746417.636196:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746417.636203:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.636211:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.636222:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.636231:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.636245:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.636362:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c6c662/0xe59b64da5b30ab44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.636381:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.636383:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.636385:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746417.637780:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.637790:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.637803:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.637808:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.637814:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.637839:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.637850:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.637858:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.637918:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746417.638600:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.638608:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.638619:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.638622:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.638627:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.638638:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.638647:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.638667:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638838:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746417.638846:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638855:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.638860:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638871:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638885:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638901:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897f40a5/0xe59b64da5b30ab4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638925:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746417.638935:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638943:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.638946:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638956:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638968:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.638977:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.638979:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.638982:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.640182:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746417.640191:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c04780cf/0xe59b64da5b30ab52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746417.640833:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.640840:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.640854:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.640858:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.640864:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.640878:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.640888:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.640896:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.643598:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746417.645355:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746417.645365:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.645376:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746417.645381:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.645392:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.645429:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.645437:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033c1366d/0xe59b64da5b30ab59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.645463:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.645465:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.645467:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.645591:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746417.647181:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.647193:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.647206:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.647211:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.647217:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.647231:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.647241:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.648588:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.648620:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746417.650238:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746417.650259:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.650272:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746417.650277:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.650302:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.650326:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.650333:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe4eb332/0xe59b64da5b30ab60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.650361:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.650363:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.650365:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746417.650803:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746417.650812:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.650824:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788746417.650835:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746417.650842:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.650855:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.650864:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.650871:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.650899:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746417.651318:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746417.651325:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.651334:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746417.651337:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.651346:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.651360:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.651376:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000434df724/0xe59b64da5b30ab67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746417.651395:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.651396:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746417.651413:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.654613:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.654624:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.654639:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.654644:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.654650:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.654664:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.654674:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.654688:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.654710:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746417.655131:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.655138:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655147:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.655150:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.655154:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655163:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655170:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655176:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655195:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788746417.655605:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.655611:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655625:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.655628:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.655632:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655641:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655649:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655656:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.655664:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788746417.656027:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.656033:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656041:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.656043:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.656047:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656055:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656074:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656081:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656089:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788746417.656342:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788746417.656352:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656361:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.656373:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656383:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656419:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656427:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c25e010/0xe59b64da5b30ab6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656449:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788746417.656453:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656459:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.656463:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656470:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656479:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746417.656483:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788746417.656488:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f636705/0xe59b64da5b30ab75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656491:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656509:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.656513:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.656517:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656518:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746417.656524:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656532:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656533:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.656539:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656546:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656550:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656557:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656565:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656585:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a30c052/0xe59b64da5b30ab7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.656590:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746417.656602:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746417.656606:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656615:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.656618:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656638:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656652:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656659:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427991c6/0xe59b64da5b30ab83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656673:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746417.656676:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656682:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746417.656685:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656692:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656702:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656709:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067665ff1/0xe59b64da5b30ab8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746417.656738:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.656741:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746417.656743:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.657267:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.657472:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.657479:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.657489:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.657492:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.657496:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.657506:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.657514:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.657521:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.657594:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746417.658034:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746417.658041:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.658049:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.658053:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.658061:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.658076:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.658092:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ca45d0/0xe59b64da5b30ab91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.658108:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.658110:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.658111:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746417.660215:0:15033:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746417.660233:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.660248:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788746417.660261:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746417.660267:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.664034:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.664046:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.664053:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746417.664076:0:15033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788746417.664454:0:15033:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1788746417.664459:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746417.664468:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.664478:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746417.664483:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.664493:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.664511:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.664520:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf7aba8/0xe59b64da5b30ab98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746417.664541:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.664543:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746417.664545:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746417.664670:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14372:x1875636163542016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112559us (113117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746417.664696:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746417.664762:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14372:1875636163542016:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788746417.664777:0:14372:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788746417.664821:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14372:1875636163542144:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788746417.664855:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746417.664899:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd445794240 going to sleep for 11 seconds 00000100:00100000:0.0:1788746417.664914:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542144 00000100:00100000:0.0:1788746417.664920:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542144 00000100:00100000:0.0:1788746417.665126:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746417.665135:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14372:x1875636163542144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788746417.665174:0:15034:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788746417.673229:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14372:x1875636163542144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8088us (8367us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788746417.673245:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746417.673492:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14372:1875636163542144:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788746417.673510:0:14372:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788746418.622867:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746419.647613:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788746420.649459:0:15749:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788746420.649462:0:15749:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788746420.649578:0:15749:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cd4585cb000 00000020:01000004:2.0:1788746420.649594:0:15749:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788746420.649607:0:15749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788746420.649622:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cd445d54d40) 00000020:00000080:2.0:1788746420.649638:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1788746420.666594:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788746420.673945:0:15749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788746420.674539:0:15749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788746420.679672:0:15749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788746420.679929:0:15749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788746420.680164:0:15749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788746420.682905:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 521: rc = 0 00100000:10000000:3.0:1788746420.683048:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:3.0:1788746420.683930:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 521: rc = 0 00100000:10000000:3.0:1788746420.688804:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 750: rc = 0 00100000:10000000:2.0:1788746420.694482:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 750: rc = 0 00100000:10000000:2.0:1788746420.694886:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 750: rc = 0 00100000:10000000:2.0:1788746420.695199:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 750: rc = 0 00100000:10000000:2.0:1788746420.701527:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 750: rc = 0 00100000:10000000:2.0:1788746420.701873:0:15749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 750: rc = 0 00000020:00000080:2.0:1788746420.703939:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788746420.703953:0:15749:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746420.703963:0:15749:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe59b64da5b30aba6 00000020:01000004:2.0:1788746420.703970:0:15749:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788746420.703989:0:15749:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746420.703993:0:15749:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746420.703998:0:15749:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788746420.704020:0:15749:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788746420.704025:0:15749:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788746420.722958:0:15749:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788746420.722994:0:15749:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.124@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788746420.722999:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788746420.723001:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788746420.723002:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746420.723008:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746420.723009:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746420.723010:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746420.723011:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746420.723013:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746420.723015:0:15749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788746420.723018:0:15749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788746420.723244:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788746420.723246:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788746420.723247:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746420.723248:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746420.723248:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746420.723250:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746420.723251:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746420.723251:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746420.723252:0:15749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788746420.723277:0:15749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788746420.723296:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788746420.723361:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746420.723454:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542272 00000100:00100000:2.0:1788746420.723462:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746420.723462:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542272 00000100:00100000:1.0:1788746420.723513:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788746420.723522:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15749:x1875636163542272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788746420.723548:0:14344:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788746420.723551:0:14344:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788746420.723554:0:14344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788746420.751460:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15749:x1875636163542272:12345-0@lo:253:mount.lustre.0 Request processed in 27930us (28090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.751477:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788746420.751596:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542272:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788746420.751610:0:15749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788746420.751613:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788746420.751615:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788746420.751616:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746420.751617:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746420.751618:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746420.751619:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746420.751621:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746420.751623:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746420.751624:0:15749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788746420.751641:0:15749:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cd4585cb000 from lustre-OST0001 10000000:01000000:1.0:1788746420.751664:0:15749:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788746420.751666:0:15749:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788746420.751673:0:15749:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cd447514d40 local copy 00010000:00010000:1.0:1788746420.751682:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746420.751914:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746420.751953:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746420.751994:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.753473:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542400 00000100:00100000:0.0:1788746420.753484:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542400 00000100:00100000:0.0:1788746420.753543:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788746420.753553:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15749:x1875636163542400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746420.753800:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15749:x1875636163542400:12345-0@lo:501:mount.lustre.0 Request processed in 248us (1846us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746420.753808:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788746420.753912:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788746420.753931:0:15749:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788746420.754113:0:15749:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788746420.754121:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.754131:0:15749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd477400000/0xe59b64da5b30a94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30a953 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746420.754163:0:15749:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cd4585cb000 10000000:01000000:3.0:1788746420.754168:0:15749:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788746420.754173:0:15749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788746420.754176:0:15749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788746420.754180:0:15749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788746420.754182:0:15749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788746420.754210:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.754345:0:15749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.754357:0:15749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746420.754377:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746420.754445:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.754471:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46e1a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746420.754546:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542528 00000100:00100000:1.0:1788746420.754552:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542528 00000100:00100000:1.0:1788746420.754594:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788746420.754603:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:15749:x1875636163542528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746420.754613:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746420.754624:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477401600/0xe59b64da5b30abb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30abad expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.754648:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477401600/0xe59b64da5b30abb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30abad expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.754658:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477401600/0xe59b64da5b30abb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30abad expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.754667:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477401600, rc 0) 00000100:00100000:1.0:1788746420.754696:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542528:12345-0@lo:101:mount.lustre.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746420.754703:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788746420.754882:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746420.754894:0:15749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abb4 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.754904:0:15749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30abb4 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746420.756839:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788746420.760974:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746420.762817:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788746420.762899:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788746420.762931:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788746420.763487:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788746420.763534:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788746420.763572:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788746420.763649:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788746420.763658:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788746420.763749:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746420.763809:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.763854:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46e1a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746420.763951:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542656 00000100:00100000:1.0:1788746420.763958:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542656 00000100:00100000:1.0:1788746420.764005:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788746420.764013:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746420.764516:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542656:12345-0@lo:501:mount.lustre.0 Request processed in 503us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746420.764524:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788746420.764621:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746420.764654:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746420.764691:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746420.764721:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746420.764786:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542784 00000100:00100000:3.0:1788746420.764791:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542784 00000100:00100000:3.0:1788746420.764826:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788746420.764833:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746420.765128:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542784:12345-0@lo:503:mount.lustre.0 Request processed in 295us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.765135:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788746420.765265:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542784:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788746420.765949:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788746420.766012:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746420.766059:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746420.766093:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746420.766344:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163542912 00000100:00100000:3.0:1788746420.766350:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163542912 00000100:00100000:3.0:1788746420.766375:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788746420.766383:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746420.766579:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163542912:12345-0@lo:502:mount.lustre.0 Request processed in 196us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.766586:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788746420.766693:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163542912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746420.766922:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788746420.766979:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788746420.767011:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788746420.767069:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788746420.767620:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788746420.767653:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788746420.767701:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788746420.767736:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788746420.767781:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788746420.767817:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746420.767872:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746420.767915:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746420.767998:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543040 00000100:00100000:2.0:1788746420.768004:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543040 00000100:00100000:2.0:1788746420.768047:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746420.768056:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163543040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.768256:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163543040:12345-0@lo:502:mount.lustre.0 Request processed in 201us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746420.768264:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788746420.768620:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746420.768692:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788746420.768702:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788746420.770616:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788746420.770627:0:15751:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788746420.770633:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746420.770635:0:15751:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788746420.770641:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746420.770654:0:15751:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cd446273380) 00000020:00000080:0.0:1788746420.770674:0:15751:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788746420.770680:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788746420.770737:0:15751:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd4585cb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788746420.770744:0:15751:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788746420.770751:0:15751:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe59b64da5b30abc2 00010000:00010000:1.0:1788746420.776024:0:15751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788746420.776805:0:15751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788746420.778902:0:15751:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788746420.780549:0:15751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788746420.780559:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746420.780565:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746420.780567:0:15751:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788746420.780569:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746420.780573:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746420.780574:0:15751:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788746420.780577:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788746420.780579:0:15751:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788746420.780581:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746420.780583:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746420.780584:0:15751:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788746420.780587:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746420.780589:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746420.780590:0:15751:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788746420.780593:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788746420.780642:0:15751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746420.780645:0:15751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746420.780646:0:15751:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788746420.780650:0:15751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788746420.780812:0:15749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788746420.780838:0:15749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788746420.780859:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abb4 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746420.780871:0:15749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030800/0xe59b64da5b30abad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abb4 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746420.780890:0:15749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd4585cb000 from 1 10000000:01000000:2.0:1788746420.780893:0:15749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746420.780925:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746420.780934:0:15749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746420.780945:0:15749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746420.780968:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746420.781024:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.781188:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.787969:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543168 00000100:00100000:0.0:1788746420.787983:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543168 00000100:00100000:0.0:1788746420.788037:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788746420.788048:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4801b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:15749:x1875636163543168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746420.788064:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746420.788097:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30abc9 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.788137:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.788148:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.788157:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9c00, rc 0) 00000100:00100000:0.0:1788746420.788236:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4801b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543168:12345-0@lo:101:mount.lustre.0 Request processed in 191us (7212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.788243:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746420.788621:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746420.788640:0:15749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746420.788651:0:15749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746420.789176:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788746420.789760:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746420.789987:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788746420.790030:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788746420.790661:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788746420.790673:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788746420.790750:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746420.790810:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.790852:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746420.791029:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543296 00000100:00100000:3.0:1788746420.791035:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543296 00000100:00100000:3.0:1788746420.791171:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788746420.791181:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4801b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746420.791485:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4801b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543296:12345-0@lo:501:mount.lustre.0 Request processed in 304us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.791493:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746420.791573:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746420.791602:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746420.791639:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.803385:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.806707:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543424 00000100:00100000:0.0:1788746420.806721:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543424 00000100:00100000:0.0:1788746420.806779:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788746420.806787:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4801b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746420.807033:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4801b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543424:12345-0@lo:503:mount.lustre.0 Request processed in 246us (15393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.807041:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788746420.807489:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746420.808157:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746420.808247:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.808299:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.808340:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.811866:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543552 00000100:00100000:0.0:1788746420.811878:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543552 00000100:00100000:0.0:1788746420.811925:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788746420.811934:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746420.812197:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543552:12345-0@lo:502:mount.lustre.0 Request processed in 264us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.812205:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788746420.812526:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746420.812786:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788746420.812861:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788746420.812914:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788746420.812952:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788746420.813003:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788746420.813063:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788746420.813111:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788746420.813147:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788746420.813181:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.813300:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.813321:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd451199000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.813623:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543680 00000100:00100000:0.0:1788746420.813636:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543680 00000100:00100000:0.0:1788746420.813667:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788746420.813675:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746420.813848:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543680:12345-0@lo:502:mount.lustre.0 Request processed in 172us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.813855:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746420.813944:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746420.814065:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788746420.814081:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788746420.818251:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746420.818264:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818267:0:15755:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788746420.818274:0:15755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd4585cb000 00000020:00000080:3.0:1788746420.818277:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746420.818283:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746420.818286:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818287:0:15755:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788746420.818289:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746420.818292:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818293:0:15755:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788746420.818296:0:15755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cd4585cb000 00000020:00000080:3.0:1788746420.818298:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746420.818352:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746420.818356:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818357:0:15755:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788746420.818359:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746420.818362:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818363:0:15755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788746420.818366:0:15755:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cd4585cb000 00000020:00000080:3.0:1788746420.818368:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746420.818415:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746420.818420:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746420.818421:0:15755:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788746420.818424:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788746420.820374:0:15749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788746420.820454:0:15749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746420.820475:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820487:0:15749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746420.820537:0:15749:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788746420.820540:0:15749:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cd4585cb000 10000000:01000000:0.0:1788746420.820543:0:15749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cd4585cb000 10000000:01000000:0.0:1788746420.820547:0:15749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746420.820554:0:15749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cd4585cb000 from 1 10000000:01000000:0.0:1788746420.820556:0:15749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746420.820589:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820598:0:15749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820609:0:15749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746420.820631:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746420.820698:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746420.820737:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543808 00000100:00100000:0.0:1788746420.820743:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543808 00000100:00100000:0.0:1788746420.820780:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746420.820789:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:15749:x1875636163543808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746420.820801:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746420.820813:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8600/0xe59b64da5b30abde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30abd7 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820834:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8600/0xe59b64da5b30abde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30abd7 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820843:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8600/0xe59b64da5b30abde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30abd7 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820851:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8600, rc 0) 00000100:00100000:0.0:1788746420.820879:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163543808:12345-0@lo:101:mount.lustre.0 Request processed in 92us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.820885:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746420.820924:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4776480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.820944:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746420.820957:0:15749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abde expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.820965:0:15749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30abde expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746420.822123:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788746420.824938:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746420.827380:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788746420.827489:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788746420.827523:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788746420.827570:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788746420.827604:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788746420.827648:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788746420.827683:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788746420.827715:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788746420.827761:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788746420.827795:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788746420.827827:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788746420.827870:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788746420.827928:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788746420.827959:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788746420.828013:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788746420.828052:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788746420.828084:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788746420.830631:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788746420.830697:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788746420.830957:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788746420.831027:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788746420.831065:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788746420.831100:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788746420.831160:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788746420.831193:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788746420.831297:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788746420.831346:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788746420.831380:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788746420.833708:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788746420.833870:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788746420.834327:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788746420.834360:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788746420.834426:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788746420.834481:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788746420.834516:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788746420.834561:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788746420.834595:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788746420.834688:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788746420.834695:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788746420.837059:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746420.837138:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746420.837181:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd48009e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746420.838646:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163543936 00000100:00100000:2.0:1788746420.838657:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163543936 00000100:00100000:2.0:1788746420.838704:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788746420.838712:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163543936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746420.839119:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163543936:12345-0@lo:501:mount.lustre.0 Request processed in 405us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746420.839127:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788746420.839189:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163543936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746420.841382:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746420.841482:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.841519:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d3930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746420.842948:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544064 00000100:00100000:3.0:1788746420.842960:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544064 00000100:00100000:3.0:1788746420.843008:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788746420.843018:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746420.844861:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544064:12345-0@lo:503:mount.lustre.0 Request processed in 1839us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.844876:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788746420.845348:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746420.848802:0:15749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746420.848886:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.848956:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.849004:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544192 00000100:00100000:2.0:1788746420.849011:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544192 00000100:00100000:2.0:1788746420.849048:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746420.849056:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.849566:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544192:12345-0@lo:502:mount.lustre.0 Request processed in 509us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746420.849576:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746420.849629:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d3930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746420.849649:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746420.849874:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788746420.849919:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788746420.849951:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788746420.849997:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788746420.850034:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788746420.850084:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788746420.854191:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788746420.854326:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788746420.854395:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788746420.854465:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788746420.854504:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788746420.857611:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788746420.857690:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788746420.857738:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788746420.857808:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788746420.857847:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788746420.857879:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788746420.857928:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788746420.857964:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788746420.857998:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788746420.858047:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788746420.858082:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788746420.858130:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788746420.858199:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788746420.858836:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788746420.858875:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788746420.858928:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788746420.858959:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788746420.858992:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788746420.859039:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788746420.859074:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788746420.859121:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788746420.859171:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788746420.860311:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788746420.860390:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788746420.860887:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788746420.860922:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788746420.860957:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788746420.861004:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788746420.861059:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788746420.861115:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.861187:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.863502:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544320 00000100:00100000:2.0:1788746420.863515:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544320 00000100:00100000:2.0:1788746420.863560:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788746420.863569:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746420.865464:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163544320:12345-0@lo:502:mount.lustre.0 Request processed in 1827us (4207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746420.865477:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788746420.865556:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d3930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746420.865578:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163544320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746420.865688:0:15749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788746420.865701:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788746420.869859:0:15760:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788746420.869893:0:15760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cd347163380) 00000020:00000080:3.0:1788746420.869915:0:15760:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788746420.869981:0:15760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cd4585cb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788746420.869986:0:15760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cd4585cb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788746420.869989:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cd4585cb000 3 00010000:00080000:3.0:1788746420.870030:0:15760:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9cd461471800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.124@tcp at head 00010000:00010000:3.0:1788746420.871569:0:15760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788746420.871751:0:15760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788746420.871785:0:15760:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788746420.871795:0:15760:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe59b64da5b30abec 00000100:00080000:3.0:1788746420.871804:0:15760:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746420.871813:0:15760:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cd461471800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:3.0:1788746420.871845:0:15760:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd48001ed80 x1875636163544448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788746420.871888:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163544448:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788746420.871946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.872011:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544448 00000100:00100000:3.0:1788746420.872017:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544448 00000100:00100000:3.0:1788746420.872045:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746420.872051:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875636163544448:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788746420.872072:0:14351:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1788746420.872098:0:14351:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe59b64da5b30abf3 00000004:00100000:3.0:1788746420.872122:0:14351:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788746420.872156:0:14351:0:(import.c:65:import_set_state_nolock()) ffff9cd44fd15000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746420.872205:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875636163544448:12345-0@lo:38:llog_process_th.0 Request processed in 152us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.872212:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788746420.872248:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd48001ed80 x1875636163544448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746420.872257:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746420.872265:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788746420.872270:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788746420.872274:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788746420.872276:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd461471800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788746420.872281:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875636163544448:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788746420.872297:0:15760:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788746420.872336:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746420.872340:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788746420.872342:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746420.872346:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:3.0:1788746420.872349:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788746420.872353:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd4521dd800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:3.0:1788746420.872365:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd48001df80 x1875636163544704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788746420.872428:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163544576:0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.872456:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.872477:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746420.872483:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163544832:0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.872512:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.872536:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163544960:0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881449:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.881509:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544576 00000100:00100000:3.0:1788746420.881516:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544576 00000100:00100000:3.0:1788746420.881560:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746420.881568:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163544576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881615:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875636163544576:12345-0@lo:400:kworker.0 Request processed in 48us (9158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.881622:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746420.881641:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544832 00000100:00100000:3.0:1788746420.881644:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544832 00000100:00100000:3.0:1788746420.881661:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544960 00000100:00100000:3.0:1788746420.881663:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544960 00000100:00100000:3.0:1788746420.881675:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746420.881680:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163544832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881720:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163544832:12345-0@lo:400:kworker.0 Request processed in 40us (9207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.881726:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746420.881736:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746420.881741:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163544960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881763:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163544960:12345-0@lo:400:kworker.0 Request processed in 22us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746420.881768:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788746420.881779:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746420.881783:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788746420.881808:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd48001f100 x1875636163544832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746420.881826:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163544832:0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881839:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163544576:0@lo:400:kworker.0 00010000:00080000:3.0:1788746420.881863:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cd48001e680 x1875636163544960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746420.881871:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163544960:0@lo:400:kworker.0 00000100:00100000:3.0:1788746420.881886:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163544704:0@lo:8:kworker.0 00000100:00100000:3.0:1788746420.881911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.881933:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163544704 00000100:00100000:3.0:1788746420.881936:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163544704 00000100:00100000:3.0:1788746420.881950:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746420.881954:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875636163544704:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788746420.881993:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875636163544704:12345-0@lo:8:kworker.0 Request processed in 37us (81us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788746420.881998:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746420.882021:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746420.882027:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746420.882031:0:3313:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788746420.882033:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163544704:0@lo:8:kworker.0 00000040:00080000:2.0:1788746420.893706:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788746420.893760:0:15749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788746420.893790:0:15749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788746420.893817:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abde expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746420.893829:0:15749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9800/0xe59b64da5b30abd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30abde expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788746420.893880:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788746420.893882:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788746420.893883:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746420.893884:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746420.893885:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746420.893886:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746420.893887:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746420.893889:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746420.893890:0:15749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788746420.893894:0:15749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788746420.893895:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788746420.893896:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788746420.893897:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788746420.893898:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788746420.893899:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788746420.893900:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788746420.893901:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788746420.893902:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788746420.893903:0:15749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788746420.893926:0:15749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788746420.893943:0:15749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163545088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788746420.894004:0:15749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746420.894037:0:15749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd47d393c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746420.894058:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545088 00000100:00100000:2.0:1788746420.894064:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545088 00000100:00100000:2.0:1788746420.894114:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788746420.894123:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163545088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788746420.894146:0:14344:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788746420.894159:0:14344:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788746420.924540:0:14344:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788746420.924592:0:14344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788746420.928442:0:14365:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788746420.928451:0:14365:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788746420.928473:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.928490:0:14365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.928509:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.928545:0:14365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.928558:0:14365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746420.928571:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163545216:0@lo:104: 00000100:00100000:3.0:1788746420.928625:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746420.928661:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd470e18d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746420.928732:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545216 00000100:00100000:0.0:1788746420.928740:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545216 00000100:00100000:0.0:1788746420.928785:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746420.928794:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163545216:12345-0@lo:104: 00010000:00010000:0.0:1788746420.928807:0:14333:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.928859:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788746420.928865:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:14365:x1875636163545216:12345-0@lo:104: Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.928871:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746420.928944:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14365:1875636163545216:0@lo:104: 00010000:00010000:3.0:1788746420.928960:0:14365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.929845:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746420.929853:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.929863:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746420.929866:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.929874:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746420.929896:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746420.929900:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788746420.929938:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.929944:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788746420.930004:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163545344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746420.930045:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746420.930117:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.930126:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30aac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aacd expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746420.930142:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746420.930144:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746420.930145:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746420.931738:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:15749:x1875636163545088:12345-0@lo:253:mount.lustre.0 Request processed in 37611us (37728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.931750:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746420.931846:0:15749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ea63f15-cd19-459c-bd52-18aa65dbbcba:15749:1875636163545088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788746420.931860:0:15749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788746420.931863:0:15749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788746420.931864:0:15749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788746420.931865:0:15749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746420.931866:0:15749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746420.931868:0:15749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746420.931869:0:15749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746420.931870:0:15749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746420.931871:0:15749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746420.931872:0:15749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788746420.931885:0:15749:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788746420.933292:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545344 00000100:00100000:0.0:1788746420.933304:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545344 00010000:00010000:0.0:1788746420.933343:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746420.933384:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746420.933426:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3317:x1875636163545344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746420.933443:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746420.933448:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933460:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933476:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477400400/0xe59b64da5b30aacd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30aac6 expref: 19 pid: 14345 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933495:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933504:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788746420.933519:0:14337:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005068865s 00010000:00010000:0.0:1788746420.933523:0:14337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933530:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933536:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933542:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933548:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746420.933559:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933568:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933590:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746420.933601:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746420.933771:0:14365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.933779:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746420.933785:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd440031800/0xe59b64da5b30abfa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746420.938318:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:3317:x1875636163545344:12345-0@lo:103:ldlm_bl.0 Request processed in 4887us (8264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746420.938330:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00080000:10000000:1.0:1788746420.938952:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746420.939141:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746420.939611:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746420.939759:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788746420.939901:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788746420.940297:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:3.0:1788746420.940446:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163545344:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788746420.940930:0:15749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788746421.000723:0:15749:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788746421.000731:0:15749:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788746421.000762:0:15749:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788746421.000822:0:15749:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788746421.000836:0:15749:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788746421.000861:0:15749:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788746421.690542:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788746421.820820:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788746421.820843:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1788746422.140240:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746422.140246:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cd448410800 from 8 10000000:01000000:0.0:1788746422.140250:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746422.140522:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746422.140536:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746422.140548:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746422.140572:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163545472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746422.140633:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746422.140688:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46e1529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746422.140950:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545472 00000100:00100000:1.0:1788746422.140957:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545472 00000100:00100000:1.0:1788746422.141007:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788746422.141016:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163545472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746422.141028:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746422.141042:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd477400e00/0xe59b64da5b30ac08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30ac01 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746422.141064:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd477400e00/0xe59b64da5b30ac08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30ac01 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746422.141075:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd477400e00/0xe59b64da5b30ac08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30ac01 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746422.141083:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd477400e00, rc 0) 00000100:00100000:1.0:1788746422.141141:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163545472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746422.141147:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788746422.141170:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163545472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746422.141184:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ac08 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746422.141198:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30ac08 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746422.141252:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163545600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788746422.141283:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746422.141306:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46e1529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746422.141525:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545600 00000100:00100000:1.0:1788746422.141530:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545600 00000100:00100000:1.0:1788746422.141560:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788746422.141567:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163545600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788746422.141587:0:14344:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746422.141602:0:14344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746422.141605:0:14344:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788746422.141678:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163545600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746422.141685:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788746422.141989:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163545600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788746422.142060:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788746422.142069:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ac08 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746422.142078:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9400/0xe59b64da5b30ac01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ac08 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746422.714614:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163545728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746422.714683:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746422.714876:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545728 00000100:00100000:1.0:1788746422.714884:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545728 00000100:00100000:1.0:1788746422.714944:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746422.714954:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163545728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746422.714987:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788746422.715028:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163545728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746422.715033:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788746422.715424:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746422.715451:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788746422.715470:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163545728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746422.718241:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746423.746566:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746424.254886:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788746424.776494:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746425.788765:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746426.303929:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746426.303935:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746426.303939:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746426.303958:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cd4521dd800 using connection 192.168.206.124@tcp/0@lo 00000100:00100000:0.0:1788746426.303985:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cd45f98bb80 x1875636163546112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746426.304039:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3315:1875636163545856:0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.304118:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.304713:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163546496:0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.308627:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.308684:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746426.308697:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163546368:0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.308739:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.308782:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163545984:0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.308809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.309289:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746426.309298:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163546240:0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.309325:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.309378:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163546112:0@lo:8:kworker.0 00000100:00100000:0.0:1788746426.309424:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.309546:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545856 00000100:00100000:0.0:1788746426.309555:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545856 00000100:00100000:0.0:1788746426.309605:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788746426.309614:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3315:x1875636163545856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.309669:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3315:x1875636163545856:12345-0@lo:400:kworker.0 Request processed in 56us (5551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746426.309676:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788746426.309711:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546496 00000100:00100000:0.0:1788746426.309715:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546496 00000100:00100000:3.0:1788746426.311343:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163545984 00000100:00100000:3.0:1788746426.311353:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163545984 00000100:00100000:0.0:1788746426.311700:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546368 00000100:00100000:0.0:1788746426.311705:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546368 00000100:00100000:1.0:1788746426.312583:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546240 00000100:00100000:1.0:1788746426.312592:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546240 00000100:00100000:1.0:1788746426.312627:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746426.312638:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163546496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746426.312720:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163546496:12345-0@lo:400:kworker.0 Request processed in 85us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746426.312728:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746426.312747:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746426.312754:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163546240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746426.312805:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163546240:12345-0@lo:400:kworker.0 Request processed in 51us (3478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746426.312811:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746426.312831:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546112 00000100:00100000:1.0:1788746426.312836:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546112 00000100:00100000:1.0:1788746426.312856:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746426.312862:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875636163546112:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788746426.312887:0:15034:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1788746426.312915:0:15034:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe59b64da5b30ac0f 00002000:00100000:1.0:1788746426.312927:0:15034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cd4461d4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788746426.312932:0:15034:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788746426.312934:0:15034:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788746426.313673:0:15034:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788746426.313700:0:15034:0:(import.c:65:import_set_state_nolock()) ffff9cd4461d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746426.313755:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875636163546112:12345-0@lo:8:kworker.0 Request processed in 892us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746426.313763:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746426.315031:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746426.315044:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163545984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746426.315124:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163545984:12345-0@lo:400:kworker.0 Request processed in 84us (6313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746426.315130:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788746426.321525:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746426.321535:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746426.321604:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3315:1875636163545856:0@lo:400:kworker.0 00010000:00080000:1.0:1788746426.321634:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f98aa00 x1875636163546496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746426.321647:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163546496:0@lo:400:kworker.0 00010000:00080000:1.0:1788746426.325771:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f98b480 x1875636163546240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746426.325807:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163546240:0@lo:400:kworker.0 00000100:00100000:1.0:1788746426.325822:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163545984:0@lo:400:kworker.0 00010000:00080000:1.0:1788746426.327583:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f98bb80 x1875636163546112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746426.327602:0:3313:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788746426.327610:0:3313:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788746426.327616:0:3313:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788746426.327619:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9cd4521dd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788746426.327641:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788746426.327648:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875636163546112:0@lo:8:kworker.0 00000004:00080000:2.0:1788746426.327659:0:14373:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788746426.327712:0:14374:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788746426.327734:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14374:1875636163546752:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788746426.327788:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746426.327816:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44fd76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788746426.327835:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546752 00000100:00100000:1.0:1788746426.327840:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546752 00000100:00100000:1.0:1788746426.327892:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746426.327901:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14374:x1875636163546752:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788746426.328393:0:14373:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500732993207ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788746426.329953:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746426.329974:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163546624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746426.330037:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788746426.331520:0:15035:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788746426.331530:0:15035:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788746426.331535:0:15035:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:0.0:1788746426.338689:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546624 00000100:00100000:0.0:1788746426.338701:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546624 00000100:00100000:0.0:1788746426.338830:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788746426.338840:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163546624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746426.338875:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746426.338938:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875636163546624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (8901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746426.338945:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788746426.338997:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd450080e00 x1875636163546624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746426.339016:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163546624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746426.339089:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788746426.339098:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163546368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746426.339138:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163546368:12345-0@lo:400:kworker.0 Request processed in 42us (30407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746426.339144:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788746426.339171:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cd45f989500 x1875636163546368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746426.339182:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163546368:0@lo:400:kworker.0 00000100:00080000:3.0:1788746426.341463:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788746426.346090:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.346103:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346133:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.346137:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.346144:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346166:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346176:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346184:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346206:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746426.346227:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.346232:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346240:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.346245:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346253:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346283:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346290:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.346322:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.346325:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.346328:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.363649:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.363663:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363681:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.363686:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.363692:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363707:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363718:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363726:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363761:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746426.363778:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.363783:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363791:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.363795:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363804:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363820:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363827:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.363845:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.363846:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.363848:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.367017:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.367030:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.367046:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.367058:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.367064:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368624:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368643:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368651:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368691:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746426.368704:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.368709:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368717:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.368721:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368730:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368745:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368764:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.368786:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.368788:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.368789:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.373603:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.373620:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373637:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.373642:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.373648:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373662:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373673:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373682:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373700:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746426.373714:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.373732:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.373740:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.373745:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746426.377004:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746426.377017:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.377033:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788746426.377038:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746426.377044:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.377160:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.377181:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.377189:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.377213:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.377216:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.377218:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.377821:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.377831:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.377840:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.377872:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746426.378014:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.378022:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.378033:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.378038:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.378058:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.378082:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.378091:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a30c052/0xe59b64da5b30ac32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.378106:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.378107:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.378109:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746426.380163:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746426.380175:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385100:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788746426.385113:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746426.385121:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385141:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385153:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385160:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385197:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.385212:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.385218:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385226:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.385243:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385252:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385268:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385275:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000427991c6/0xe59b64da5b30ac39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.385294:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.385297:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.385299:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746426.388479:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746426.388492:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388508:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788746426.388512:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746426.388519:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388533:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388543:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388559:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388583:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.388601:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.388606:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388614:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.388619:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388628:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388645:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388652:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd41ca17/0xe59b64da5b30ac40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.388670:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.388672:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.388673:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.393311:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.393325:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.393342:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.393347:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.393352:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.399290:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.399314:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.399330:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.399506:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.399862:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.399876:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.399886:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.399891:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.399902:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.399921:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.399929:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c1366d/0xe59b64da5b30ac47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.399957:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.399960:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.399963:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.400438:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.400447:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400460:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.400465:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.400471:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400482:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400491:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400498:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400522:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.400874:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.400882:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.400891:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.400895:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.400918:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.400932:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746426.400937:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788746426.400941:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434df724/0xe59b64da5b30ac4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400945:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400962:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788746426.400962:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.400965:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.400968:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746426.400968:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.400975:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400987:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.400994:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401000:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401023:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.401045:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.401060:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.401067:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.401071:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.401089:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.401101:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.401121:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c04780cf/0xe59b64da5b30ac55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.401141:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.401144:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.401145:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.401443:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.401450:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401457:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.401461:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.401465:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401475:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401493:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401501:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401520:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746426.401871:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.401877:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401886:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.401889:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.401894:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401904:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401912:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401920:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.401951:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746426.402003:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746426.402011:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402020:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746426.402025:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402034:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402064:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402083:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecf91524/0xe59b64da5b30ac5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402103:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746426.402112:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402119:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746426.402122:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402130:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402141:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402149:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008765db52/0xe59b64da5b30ac63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.402164:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746426.402166:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746426.402168:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.402335:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.406003:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.406014:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.406030:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.406034:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.406040:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.406053:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.406063:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.406071:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.406106:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746426.407382:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.407394:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.407422:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.407427:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.407453:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.407474:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.407481:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c967310e/0xe59b64da5b30ac6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.407510:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.407512:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.407513:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.408495:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.408505:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.408519:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.408531:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.408537:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.408551:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.408561:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.408568:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.411256:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746426.413643:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.413656:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.413673:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.413677:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.413684:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.413698:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.413708:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.413723:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.413777:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788746426.414960:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.414969:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.414982:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.414987:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.414992:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.415004:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.415114:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.415123:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416700:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788746426.416713:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416726:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477401400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.416731:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416740:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416759:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416786:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897f40a5/0xe59b64da5b30ac71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416832:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746426.416836:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416842:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd477400200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.416845:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416852:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416861:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416867:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6c6c662/0xe59b64da5b30ac78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416882:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.416885:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416890:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.416900:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416907:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416917:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.416924:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.416926:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.416927:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.417036:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746426.417043:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30ac7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746426.417674:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.417682:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.417693:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.417697:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.417702:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.417714:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.417723:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.417730:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.419616:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.419628:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.419640:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.419645:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.419655:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.419675:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.419686:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.419696:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.419699:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.420329:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.424285:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746426.424298:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30ac86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.424336:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788746426.427630:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788746426.428345:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.428356:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.428381:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.428386:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.428392:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.428442:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.428453:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.428461:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.428479:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746426.428867:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746426.428876:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.428886:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479400 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746426.428891:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.428913:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.428929:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.428937:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e24ea7e/0xe59b64da5b30ac8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746426.428958:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746426.428960:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746426.428963:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.428990:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.428998:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.429006:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.429008:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.429013:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.429022:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.429042:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.430164:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.430187:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746426.431143:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.431151:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431164:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.431169:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431179:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431198:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431208:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c052fa87/0xe59b64da5b30ac94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431231:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.431232:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.431234:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.431329:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.431335:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.431346:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.431350:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.431356:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.431368:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.431378:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.431386:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.431873:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746426.431938:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.431944:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431957:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479600 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.431969:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431980:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.431995:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.432013:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7993a4/0xe59b64da5b30ac9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.432032:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.432034:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.432035:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.433985:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.433996:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434009:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.434014:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.434020:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434033:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434042:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434125:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434148:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746426.434312:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.434319:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.434327:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.434331:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.434340:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.434355:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.434370:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040731cf1/0xe59b64da5b30aca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.434387:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.434388:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.434390:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.434754:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.434760:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434769:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.434777:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.434782:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434791:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434800:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434808:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.434865:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746426.435220:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.435225:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.435233:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.435236:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.435240:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.435259:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.435267:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.435279:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438455:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746426.438471:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438484:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.438489:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438500:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438521:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438528:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30aca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438555:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.438559:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438583:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.438586:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438594:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438605:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.438612:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.438614:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.438616:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.438767:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746426.438775:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30acb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788746426.442211:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.442224:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442239:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.442346:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.442353:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442369:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442381:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442389:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442448:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746426.442870:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.442876:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442885:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.442888:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.442893:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442902:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442910:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442917:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.442926:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788746426.443158:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746426.443166:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443175:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478e00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.443179:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443187:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443202:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443217:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e525a0e4/0xe59b64da5b30acb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443252:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746426.443256:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443267:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746426.443270:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443277:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443286:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.443289:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443297:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff91065/0xe59b64da5b30acbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.443310:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.443312:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746426.443314:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746426.443791:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788746426.443798:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.443810:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788746426.443820:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746426.443824:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.443835:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.443843:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.443850:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.443862:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746426.443891:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746426.443899:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443909:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746426.443914:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443923:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443938:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443945:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e373c8d0/0xe59b64da5b30acc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746426.443978:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.443980:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746426.443983:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788746426.448493:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788746426.448506:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.448531:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788746426.448536:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746426.448542:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.448557:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.448827:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.448836:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746426.448859:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788746426.449099:0:15035:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:1.0:1788746426.449299:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746426.449307:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.449317:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746426.449322:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.449332:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.449350:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.449372:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe505ce0/0xe59b64da5b30accc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746426.449393:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.449394:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746426.449411:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746426.450365:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14374:1875636163546752:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788746426.450383:0:14374:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788746426.450465:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14374:1875636163546880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788746426.450518:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746426.450572:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46e152900 going to sleep for 11 seconds 00000100:00100000:3.0:1788746426.450637:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14374:x1875636163546752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 122736us (122846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746426.450648:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746426.450675:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163546880 00000100:00100000:3.0:1788746426.450681:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163546880 00000100:00100000:3.0:1788746426.450725:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746426.451652:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14374:x1875636163546880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788746426.451700:0:15035:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788746426.470251:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14374:x1875636163546880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18601us (19723us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788746426.470276:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746426.470847:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f989500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14374:1875636163546880:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788746426.470863:0:14374:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788746426.810811:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788746427.765369:0:16109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788746427.842617:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163547008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746427.842684:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746427.842764:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547008 00000100:00100000:0.0:1788746427.842771:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547008 00000100:00100000:0.0:1788746427.842815:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746427.842824:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163547008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746427.842859:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746427.842900:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163547008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746427.842907:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746427.842951:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163547008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788746427.843362:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746428.859573:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746429.739025:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746429.739197:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531136 00000100:00100000:2.0:1788746429.739208:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531136 00000100:00100000:2.0:1788746429.739251:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:2.0:1788746429.739259:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2346:x1875636141531136:12345-192.168.206.24@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788746429.739286:0:14344:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 5c9d994d-3b44-470f-b59f-3309d681526d@192.168.206.24@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1788746429.739316:0:14344:0:(genops.c:1384:class_connect()) connect: client 5c9d994d-3b44-470f-b59f-3309d681526d, cookie 0xe59b64da5b30acd3 00000100:00080000:2.0:1788746429.739484:0:14344:0:(import.c:65:import_set_state_nolock()) ffff9cd34508e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746429.739549:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+5:2346:x1875636141531136:12345-192.168.206.24@tcp:250:mount.lustre.0 Request processed in 289us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746429.739556:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 75 00000100:00100000:1.0:1788746429.761357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746429.761560:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531264 00000100:00100000:0.0:1788746429.761571:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531264 00000100:00100000:0.0:1788746429.761629:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 76 00000100:00100000:0.0:1788746429.761639:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+5:13719:x1875636141531264:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788746429.761655:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746429.761672:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8e00/0xe59b64da5b30acda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5c1 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.761699:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8e00/0xe59b64da5b30acda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5c1 expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.761711:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8e00/0xe59b64da5b30acda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5c1 expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.761720:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8e00, rc 0) 00000100:00100000:0.0:1788746429.761898:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+6:13719:x1875636141531264:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 259us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746429.761905:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 76 00000100:00100000:3.0:1788746429.767562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746429.768874:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531392 00000100:00100000:0.0:1788746429.768886:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531392 00000100:00100000:0.0:1788746429.768995:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:0.0:1788746429.769006:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4460a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+6:13719:x1875636141531392:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788746429.769326:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4460a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+6:13719:x1875636141531392:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 320us (1772us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746429.769333:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 77 00000100:00100000:3.0:1788746429.771898:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746429.778346:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531520 00000100:00100000:2.0:1788746429.778362:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531520 00000100:00100000:0.0:1788746429.779560:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:0.0:1788746429.779571:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+6:13719:x1875636141531520:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788746429.779585:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746429.779612:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8c00/0xe59b64da5b30ace1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5c8 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.779639:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8c00/0xe59b64da5b30ace1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5c8 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.779648:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8c00/0xe59b64da5b30ace1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5c8 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746429.779656:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8c00, rc 0) 00000100:00100000:0.0:1788746429.779842:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+7:13719:x1875636141531520:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 271us (7950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746429.779849:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 78 00000100:00100000:1.0:1788746429.787777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746429.787936:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531648 00000100:00100000:0.0:1788746429.787945:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531648 00000100:00100000:0.0:1788746429.787997:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:0.0:1788746429.788007:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+7:13719:x1875636141531648:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788746429.788297:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+8:13719:x1875636141531648:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 291us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746429.788306:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 79 00000100:00100000:2.0:1788746429.805806:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.805986:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531776 00000100:00100000:1.0:1788746429.805995:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531776 00000100:00100000:1.0:1788746429.806047:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:1.0:1788746429.806067:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+8:13719:x1875636141531776:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746429.806477:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+8:13719:x1875636141531776:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 420us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.806486:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 80 00000100:00100000:3.0:1788746429.809275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.809528:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141531904 00000100:00100000:1.0:1788746429.809538:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141531904 00000100:00100000:1.0:1788746429.809597:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 81 00000100:00100000:1.0:1788746429.809607:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+8:13737:x1875636141531904:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746429.810125:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+8:13737:x1875636141531904:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 518us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.810135:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 81 00000100:00100000:3.0:1788746429.849647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746429.849803:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532032 00000100:00100000:0.0:1788746429.849813:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532032 00000100:00100000:0.0:1788746429.849877:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:0.0:1788746429.849887:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+8:13737:x1875636141532032:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746429.850182:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+8:13737:x1875636141532032:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 295us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746429.850190:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 82 00000100:00100000:2.0:1788746429.856763:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.857087:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532160 00000100:00100000:1.0:1788746429.857097:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532160 00000100:00100000:1.0:1788746429.857156:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 83 00000100:00100000:1.0:1788746429.857165:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+8:13719:x1875636141532160:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746429.857180:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746429.857195:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479800/0xe59b64da5b30ace8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5f2 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.857221:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479800/0xe59b64da5b30ace8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f2 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.857232:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479800/0xe59b64da5b30ace8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f2 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.857241:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479800, rc 0) 00000100:00100000:1.0:1788746429.857371:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+9:13719:x1875636141532160:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 206us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.857378:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 83 00000100:00100000:3.0:1788746429.866705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746429.869876:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532288 00000100:00100000:2.0:1788746429.869889:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532288 00000100:00100000:2.0:1788746429.869947:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:2.0:1788746429.869955:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+9:13719:x1875636141532288:12345-192.168.206.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788746429.869977:0:14345:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788746429.869998:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788746429.870002:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788746429.870005:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788746429.870007:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788746429.872344:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+9:13719:x1875636141532288:12345-192.168.206.24@tcp:256:mount.lustre.0 Request processed in 2382us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.872357:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 84 00000100:00100000:3.0:1788746429.882033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00010000:00010000:2.0:1788746429.884442:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746429.884563:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532416 00000100:00100000:1.0:1788746429.884574:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532416 00000100:00100000:1.0:1788746429.884671:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00100000:1.0:1788746429.884681:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+9:13719:x1875636141532416:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746429.884696:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746429.884712:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b5f9 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.884804:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 10 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.884831:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 10 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746429.884840:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478e00, rc 0) 00000100:00100000:1.0:1788746429.884917:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+10:13719:x1875636141532416:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 237us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.884924:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 85 00000100:00100000:3.0:1788746429.889609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.890114:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532544 00000100:00100000:1.0:1788746429.890123:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532544 00000100:00100000:1.0:1788746429.890182:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00100000:1.0:1788746429.890192:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+10:13719:x1875636141532544:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788746429.890661:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+10:13719:x1875636141532544:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 470us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.890670:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 86 00000100:00100000:2.0:1788746429.894671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.894776:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532672 00000100:00100000:1.0:1788746429.894786:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532672 00000100:00100000:1.0:1788746429.894838:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:1.0:1788746429.894849:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+10:13719:x1875636141532672:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746429.895363:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+10:13719:x1875636141532672:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 514us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.895372:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 87 00000100:00100000:3.0:1788746429.899289:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746429.899665:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532800 00000100:00100000:0.0:1788746429.899675:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532800 00000100:00100000:0.0:1788746429.899826:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 88 00000100:00100000:0.0:1788746429.899837:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+10:13741:x1875636141532800:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746429.900533:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+10:13741:x1875636141532800:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 695us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746429.900543:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 88 00000100:00100000:3.0:1788746429.913948:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746429.918821:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141532928 00000100:00100000:1.0:1788746429.918836:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141532928 00000100:00100000:1.0:1788746429.918914:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 89 00000100:00100000:1.0:1788746429.918924:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+10:13741:x1875636141532928:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746429.919198:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+10:13741:x1875636141532928:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 275us (5257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.919205:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 89 00000100:00100000:1.0:1788746429.930472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746429.930567:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533056 00000100:00100000:3.0:1788746429.930578:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533056 00000100:00100000:3.0:1788746429.930616:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746429.930623:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875636141533056:12345-192.168.206.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788746429.930652:0:14350:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from a624fde4-21fb-41bf-be92-748365f2b29a@192.168.206.24@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788746429.930699:0:14350:0:(genops.c:1384:class_connect()) connect: client a624fde4-21fb-41bf-be92-748365f2b29a, cookie 0xe59b64da5b30acf6 00000004:00100000:3.0:1788746429.930728:0:14350:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788746429.930733:0:14350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788746429.996257:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9cd45f48f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746429.996338:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:2346:x1875636141533056:12345-192.168.206.24@tcp:38:mount.lustre.0 Request processed in 65711us (65872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746429.996707:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:2.0:1788746430.003644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746430.004197:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746430.004613:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533184 00000100:00100000:0.0:1788746430.004623:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533184 00000100:00100000:0.0:1788746430.004693:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533312 00000100:00100000:0.0:1788746430.004697:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533312 00000100:00100000:0.0:1788746430.004715:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:0.0:1788746430.004725:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+7:0:x1875636141533184:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788746430.004884:0:14349:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788746430.004972:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+7:0:x1875636141533184:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 247us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746430.004979:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:0.0:1788746430.004999:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:0.0:1788746430.005006:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533312:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788746430.005018:0:14349:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788746430.006136:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533312:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 1124us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746430.006164:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00080000:3.0:1788746430.006697:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746430.009129:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746430.009275:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533440 00000100:00100000:1.0:1788746430.009285:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533440 00000100:00100000:1.0:1788746430.009341:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:1.0:1788746430.009350:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533440:12345-192.168.206.24@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788746430.009447:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533440:12345-192.168.206.24@tcp:40:mount.lustre.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746430.009454:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:2.0:1788746430.013151:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746430.013200:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746430.013230:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746430.013338:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533824 00000100:00100000:0.0:1788746430.013348:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533824 00000100:00100000:0.0:1788746430.013424:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:0.0:1788746430.013435:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533824:12345-192.168.206.24@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788746430.013984:0:14352:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 489us 00000100:00100000:3.0:1788746430.016463:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533568 00000100:00100000:3.0:1788746430.016475:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533568 00000100:00100000:3.0:1788746430.016520:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533696 00000100:00100000:3.0:1788746430.016523:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533696 00000100:00100000:3.0:1788746430.016541:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:3.0:1788746430.016549:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875636141533568:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746430.016579:0:15034:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from a624fde4-21fb-41bf-be92-748365f2b29a@192.168.206.24@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788746430.016616:0:15034:0:(genops.c:1384:class_connect()) connect: client a624fde4-21fb-41bf-be92-748365f2b29a, cookie 0xe59b64da5b30acfd 00002000:00100000:3.0:1788746430.016627:0:15034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a624fde4-21fb-41bf-be92-748365f2b29a/ffff9cd44769c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746430.016650:0:15034:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746430.016946:0:15034:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788746430.016977:0:15034:0:(import.c:65:import_set_state_nolock()) ffff9cd44fd13000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746430.017048:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:2346:x1875636141533568:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 498us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746430.017069:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:3.0:1788746430.017088:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:3.0:1788746430.017093:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875636141533696:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746430.017109:0:15034:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from a624fde4-21fb-41bf-be92-748365f2b29a@192.168.206.24@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788746430.017129:0:15034:0:(genops.c:1384:class_connect()) connect: client a624fde4-21fb-41bf-be92-748365f2b29a, cookie 0xe59b64da5b30ad04 00002000:00100000:3.0:1788746430.017135:0:15034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a624fde4-21fb-41bf-be92-748365f2b29a/ffff9cd44fd10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746430.017149:0:15034:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746430.017271:0:15034:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788746430.017300:0:15034:0:(import.c:65:import_set_state_nolock()) ffff9cd480950800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746430.017324:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:2346:x1875636141533696:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 230us (4093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746430.017331:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000004:00200000:3.0:1788746430.029156:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788746430.029266:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:13719:x1875636141533824:12345-192.168.206.24@tcp:33:mount.lustre.0 Request processed in 15829us (16061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746430.029278:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:2.0:1788746430.189044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746430.189184:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141533952 00000100:00100000:1.0:1788746430.189192:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141533952 00000100:00100000:1.0:1788746430.189248:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:1.0:1788746430.189258:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+6:13762:x1875636141533952:12345-192.168.206.24@tcp:101:mkdir.0 00010000:00010000:1.0:1788746430.189274:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746430.189297:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479200/0xe59b64da5b30ad0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b623 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189351:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189377:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189390:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746430.189461:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746430.189465:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746430.189498:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189519:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479200/0xe59b64da5b30ad0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b623 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189536:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b623 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746430.189544:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:1.0:1788746430.189547:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746430.189551:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479400, rc 0) 00000100:00100000:1.0:1788746430.189602:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+7:13762:x1875636141533952:12345-192.168.206.24@tcp:101:mkdir.0 Request processed in 346us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746430.189609:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00010000:00010000:0.0:1788746430.906560:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746431.419713:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746431.419735:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746431.419801:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746431.419864:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547136 00000100:00100000:0.0:1788746431.419872:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547136 00000100:00100000:0.0:1788746431.419924:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746431.419934:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163547136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788746431.419955:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788746431.427256:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746431.427373:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875636163547136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7436us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746431.427385:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746431.427499:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746431.428256:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3315:1875636163547264:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428382:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746431.428446:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547264 00000100:00100000:1.0:1788746431.428452:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547264 00000100:00100000:1.0:1788746431.428489:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788746431.428508:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3315:x1875636163547264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428559:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3315:x1875636163547264:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746431.428571:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788746431.428620:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3315:1875636163547264:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428661:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163547392:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428688:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746431.428856:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163547520:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428883:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746431.428917:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547520 00000100:00100000:1.0:1788746431.428921:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547520 00000100:00100000:1.0:1788746431.428948:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746431.428954:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.428989:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875636163547520:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746431.428995:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746431.429021:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875636163547520:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.429064:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746431.429071:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163547648:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.429094:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746431.429120:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547648 00000100:00100000:1.0:1788746431.429125:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547648 00000100:00100000:1.0:1788746431.429159:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746431.429164:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.429202:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163547648:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746431.429215:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746431.429243:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163547648:0@lo:400:kworker.0 00000100:00080000:1.0:1788746431.429256:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746431.429278:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163547776:0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.429301:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746431.429330:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547776 00000100:00100000:1.0:1788746431.429333:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547776 00000100:00100000:1.0:1788746431.429359:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746431.429366:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746431.429428:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163547776:12345-0@lo:400:kworker.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746431.429440:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746431.429474:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163547776:0@lo:400:kworker.0 00000100:00080000:1.0:1788746431.429491:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746431.429578:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547392 00000100:00100000:3.0:1788746431.429588:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547392 00000100:00100000:3.0:1788746431.429630:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746431.429638:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163547392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746431.429676:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd450082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875636163547392:12345-0@lo:400:kworker.0 Request processed in 40us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746431.429683:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746431.429708:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875636163547392:0@lo:400:kworker.0 00000100:00080000:1.0:1788746431.429745:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788746431.516394:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788746431.516427:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a624fde4-21fb-41bf-be92-748365f2b29a 00000001:00080000:0.0:1788746431.516434:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1788746431.930652:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746431.999506:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a624fde4-21fb-41bf-be92-748365f2b29a 00000100:00100000:3.0:1788746432.192989:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.193956:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534080 00000100:00100000:1.0:1788746432.193967:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534080 00000100:00100000:1.0:1788746432.194068:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:1.0:1788746432.194079:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+7:13815:x1875636141534080:12345-192.168.206.24@tcp:41:lfs.0 00000004:00000024:1.0:1788746432.194116:0:14349:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788746432.194208:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+7:13815:x1875636141534080:12345-192.168.206.24@tcp:41:lfs.0 Request processed in 131us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.194215:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00080000:2.0:1788746432.195575:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746432.204897:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746432.205159:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534208 00000100:00100000:0.0:1788746432.205169:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534208 00000100:00100000:0.0:1788746432.205259:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:0.0:1788746432.205269:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a624fde4-21fb-41bf-be92-748365f2b29a+5:13815:x1875636141534208:12345-192.168.206.24@tcp:13:lfs.0 00002000:00000024:0.0:1788746432.205302:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746432.205380:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a624fde4-21fb-41bf-be92-748365f2b29a+5:13815:x1875636141534208:12345-192.168.206.24@tcp:13:lfs.0 Request processed in 112us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.205387:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00080000:2.0:1788746432.205786:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746432.209501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.209609:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534336 00000100:00100000:2.0:1788746432.209620:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534336 00000100:00100000:2.0:1788746432.209692:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:2.0:1788746432.209702:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a624fde4-21fb-41bf-be92-748365f2b29a+5:13815:x1875636141534336:12345-192.168.206.24@tcp:13:lfs.0 00002000:00000024:2.0:1788746432.209752:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746432.209849:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a624fde4-21fb-41bf-be92-748365f2b29a+5:13815:x1875636141534336:12345-192.168.206.24@tcp:13:lfs.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746432.209857:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00080000:1.0:1788746432.209973:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788746432.395088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.395170:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534464 00000100:00100000:2.0:1788746432.395179:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534464 00000100:00100000:2.0:1788746432.395240:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 91 00000100:00100000:2.0:1788746432.395249:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+10:13846:x1875636141534464:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788746432.395264:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746432.395280:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44e00/0xe59b64da5b30ad19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b62a expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746432.395308:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44e00/0xe59b64da5b30ad19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b62a expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746432.395318:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44e00/0xe59b64da5b30ad19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b62a expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746432.395326:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44e00, rc 0) 00000100:00100000:2.0:1788746432.395452:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d1e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141534464:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 203us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746432.395469:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 91 00000100:00100000:0.0:1788746432.402573:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.402671:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534592 00000100:00100000:1.0:1788746432.402680:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534592 00000100:00100000:1.0:1788746432.402771:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 92 00000100:00100000:1.0:1788746432.402780:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141534592:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788746432.403092:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141534592:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 312us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.403100:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 92 00000100:00100000:0.0:1788746432.408484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.408581:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534720 00000100:00100000:2.0:1788746432.408592:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534720 00000100:00100000:2.0:1788746432.408644:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:2.0:1788746432.408655:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141534720:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788746432.409104:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141534720:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 450us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746432.409118:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 93 00000100:00100000:3.0:1788746432.428067:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.428430:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534848 00000100:00100000:1.0:1788746432.428440:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534848 00000100:00100000:1.0:1788746432.428496:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:1.0:1788746432.428506:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+11:13853:x1875636141534848:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746432.428765:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+11:13853:x1875636141534848:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 260us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.428773:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 94 00000100:00100000:0.0:1788746432.459683:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.459852:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141534976 00000100:00100000:2.0:1788746432.459862:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141534976 00000100:00100000:2.0:1788746432.459972:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 95 00000100:00100000:2.0:1788746432.459982:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13853:x1875636141534976:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788746432.460290:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13853:x1875636141534976:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 308us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746432.460298:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 95 00000100:00100000:2.0:1788746432.470512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746432.470909:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535104 00000100:00100000:0.0:1788746432.470918:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535104 00000100:00100000:0.0:1788746432.470981:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 96 00000100:00100000:0.0:1788746432.470991:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+11:13846:x1875636141535104:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788746432.471006:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746432.471035:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd47d1f8000/0xe59b64da5b30ad20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b654 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746432.471072:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd47d1f8000/0xe59b64da5b30ad20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b654 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746432.471083:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd47d1f8000/0xe59b64da5b30ad20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b654 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746432.471092:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8000, rc 0) 00000100:00100000:0.0:1788746432.471164:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+12:13846:x1875636141535104:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 165us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.471184:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 96 00000100:00100000:0.0:1788746432.474670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.474815:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535232 00000100:00100000:2.0:1788746432.474824:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535232 00000100:00100000:2.0:1788746432.474876:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:2.0:1788746432.474887:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47741a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+12:13846:x1875636141535232:12345-192.168.206.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788746432.474910:0:14345:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788746432.474943:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788746432.474948:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788746432.474951:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788746432.474953:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788746432.477093:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47741a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+12:13846:x1875636141535232:12345-192.168.206.24@tcp:256:mount.lustre.0 Request processed in 2199us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.477108:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 97 00000100:00100000:3.0:1788746432.481776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.481998:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535360 00000100:00100000:1.0:1788746432.482008:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535360 00000100:00100000:1.0:1788746432.482219:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:1.0:1788746432.482230:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+12:13846:x1875636141535360:12345-192.168.206.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746432.482963:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746432.482984:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b65b expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.483117:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.483129:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.483139:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479200, rc 0) 00000100:00100000:1.0:1788746432.483203:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:13846:x1875636141535360:12345-192.168.206.24@tcp:101:mount.lustre.0 Request processed in 975us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.483219:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 98 00000100:00100000:0.0:1788746432.491508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.491715:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535488 00000100:00100000:1.0:1788746432.491724:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535488 00000100:00100000:1.0:1788746432.491804:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:1.0:1788746432.491814:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13846:x1875636141535488:12345-192.168.206.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788746432.492219:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13846:x1875636141535488:12345-192.168.206.24@tcp:501:mount.lustre.0 Request processed in 406us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.492227:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 99 00000100:00100000:2.0:1788746432.505707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.508161:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535616 00000100:00100000:1.0:1788746432.508176:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535616 00000100:00100000:1.0:1788746432.508243:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00100000:1.0:1788746432.508254:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:13846:x1875636141535616:12345-192.168.206.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746432.509163:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:13846:x1875636141535616:12345-192.168.206.24@tcp:503:mount.lustre.0 Request processed in 906us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.509175:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 100 00000100:00100000:3.0:1788746432.516240:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.516336:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535744 00000100:00100000:1.0:1788746432.516357:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535744 00000100:00100000:1.0:1788746432.516447:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:1.0:1788746432.516457:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13858:x1875636141535744:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746432.516700:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13858:x1875636141535744:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 245us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.516710:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 101 00000100:00100000:3.0:1788746432.522209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.523940:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141535872 00000100:00100000:1.0:1788746432.523953:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141535872 00000100:00100000:1.0:1788746432.524021:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:1.0:1788746432.524031:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:13858:x1875636141535872:12345-192.168.206.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746432.524751:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:13858:x1875636141535872:12345-192.168.206.24@tcp:502:llog_process_th.0 Request processed in 718us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.524761:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 102 00000100:00100000:2.0:1788746432.552523:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.552751:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536000 00000100:00100000:1.0:1788746432.552761:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536000 00000100:00100000:1.0:1788746432.552812:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746432.552820:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875636141536000:12345-192.168.206.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788746432.552847:0:14350:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 19c3ee62-be91-41d0-96d8-f823f5b214e5@192.168.206.24@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1788746432.552888:0:14350:0:(genops.c:1384:class_connect()) connect: client 19c3ee62-be91-41d0-96d8-f823f5b214e5, cookie 0xe59b64da5b30ad2e 00000004:00100000:1.0:1788746432.552914:0:14350:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788746432.553052:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9cd45fb89800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746432.553125:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2346:x1875636141536000:12345-192.168.206.24@tcp:38:mount.lustre.0 Request processed in 303us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.553133:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:3.0:1788746432.558928:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746432.558974:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746432.559097:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536256 00000100:00100000:0.0:1788746432.559108:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536256 00000100:00100000:0.0:1788746432.559181:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536128 00000100:00100000:0.0:1788746432.559184:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536128 00000100:00100000:0.0:1788746432.559204:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:0.0:1788746432.559215:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+7:13846:x1875636141536256:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788746432.559249:0:14350:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788746432.559310:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+7:13846:x1875636141536256:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.559318:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:0.0:1788746432.559336:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:0.0:1788746432.559342:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:0:x1875636141536128:12345-192.168.206.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788746432.559353:0:14350:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788746432.559375:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:0:x1875636141536128:12345-192.168.206.24@tcp:41:mount.lustre.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.559381:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00080000:2.0:1788746432.559708:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746432.564073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746432.564339:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536384 00000100:00100000:0.0:1788746432.564349:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536384 00000100:00100000:0.0:1788746432.564425:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746432.564435:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:13846:x1875636141536384:12345-192.168.206.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788746432.564531:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:13846:x1875636141536384:12345-192.168.206.24@tcp:40:mount.lustre.0 Request processed in 97us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.564555:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746432.572744:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.572856:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536768 00000100:00100000:2.0:1788746432.572865:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536768 00000100:00100000:2.0:1788746432.572912:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:2.0:1788746432.572931:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:13846:x1875636141536768:12345-192.168.206.24@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788746432.573001:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788746432.573131:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:13846:x1875636141536768:12345-192.168.206.24@tcp:33:mount.lustre.0 Request processed in 210us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746432.573139:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:2.0:1788746432.584302:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746432.584352:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746432.584934:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536512 00000100:00100000:3.0:1788746432.584945:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536512 00000100:00100000:3.0:1788746432.584989:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536640 00000100:00100000:3.0:1788746432.584993:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536640 00000100:00100000:3.0:1788746432.585008:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:3.0:1788746432.585025:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875636141536512:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746432.585069:0:15034:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 19c3ee62-be91-41d0-96d8-f823f5b214e5@192.168.206.24@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1788746432.585100:0:15034:0:(genops.c:1384:class_connect()) connect: client 19c3ee62-be91-41d0-96d8-f823f5b214e5, cookie 0xe59b64da5b30ad35 00002000:00100000:3.0:1788746432.585111:0:15034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 19c3ee62-be91-41d0-96d8-f823f5b214e5/ffff9cd480950000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746432.585122:0:15034:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746432.585363:0:15034:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788746432.585393:0:15034:0:(import.c:65:import_set_state_nolock()) ffff9cd480956800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746432.585875:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2346:x1875636141536512:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 849us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746432.585897:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:3.0:1788746432.585933:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:3.0:1788746432.585938:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875636141536640:12345-192.168.206.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746432.585957:0:15034:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 19c3ee62-be91-41d0-96d8-f823f5b214e5@192.168.206.24@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1788746432.585974:0:15034:0:(genops.c:1384:class_connect()) connect: client 19c3ee62-be91-41d0-96d8-f823f5b214e5, cookie 0xe59b64da5b30ad3c 00002000:00100000:3.0:1788746432.585981:0:15034:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 19c3ee62-be91-41d0-96d8-f823f5b214e5/ffff9cd480954000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746432.585987:0:15034:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746432.586307:0:15034:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788746432.586326:0:15034:0:(import.c:65:import_set_state_nolock()) ffff9cd480957800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746432.586356:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2346:x1875636141536640:12345-192.168.206.24@tcp:8:mount.lustre.0 Request processed in 416us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746432.586363:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:0.0:1788746432.828395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746432.828515:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141536896 00000100:00100000:1.0:1788746432.828536:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141536896 00000100:00100000:1.0:1788746432.828591:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:1.0:1788746432.828601:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:13879:x1875636141536896:12345-192.168.206.24@tcp:101:mkdir.0 00010000:00010000:1.0:1788746432.828619:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746432.828637:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30ad43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b685 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828691:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828704:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828716:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746432.828747:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746432.828751:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746432.828767:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828790:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30ad43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828808:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746432.828816:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:1.0:1788746432.828819:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746432.828823:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478c00, rc 0) 00000100:00100000:1.0:1788746432.828889:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+7:13879:x1875636141536896:12345-192.168.206.24@tcp:101:mkdir.0 Request processed in 289us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746432.828897:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00010000:00010000:0.0:1788746432.954897:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746432.954970:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746432.954993:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163547904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746432.955076:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746432.955248:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163547904 00000100:00100000:0.0:1788746432.955255:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163547904 00000100:00100000:0.0:1788746432.955302:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746432.955312:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163547904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746432.955332:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746432.955387:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163547904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746432.955393:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788746432.955527:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163547904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788746433.978649:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746434.491210:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746435.006754:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746435.074239:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 19c3ee62-be91-41d0-96d8-f823f5b214e5 00000001:00100000:2.0:1788746435.074251:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a624fde4-21fb-41bf-be92-748365f2b29a 00000001:02000400:2.0:1788746435.795777:0:16315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788746436.028707:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746436.538741:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163548032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746436.538810:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746436.538920:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548032 00000100:00100000:2.0:1788746436.538929:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548032 00000100:00100000:2.0:1788746436.538991:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746436.539010:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163548032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746436.539048:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746436.539092:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163548032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746436.539099:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788746436.539122:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746436.539156:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788746436.539177:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd344b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163548032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746436.543111:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163548160:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543175:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746436.543230:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548160 00000100:00100000:1.0:1788746436.543308:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548160 00000100:00100000:1.0:1788746436.543351:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788746436.543360:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3314:x1875636163548160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543430:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3314:x1875636163548160:12345-0@lo:400:kworker.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746436.543437:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788746436.543481:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163548160:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543557:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163548288:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543585:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746436.543603:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746436.543608:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543631:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746436.543660:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163548416:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543682:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746436.543704:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746436.543710:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd450083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163548544:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.543731:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746436.543759:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548672 00000100:00100000:1.0:1788746436.543763:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548672 00000100:00100000:1.0:1788746436.543812:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548416 00000100:00100000:1.0:1788746436.543815:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548416 00000100:00100000:1.0:1788746436.544158:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548544 00000100:00100000:1.0:1788746436.544162:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548544 00000100:00100000:1.0:1788746436.544181:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746436.544189:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163548672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.544311:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875636163548672:12345-0@lo:400:kworker.0 Request processed in 47us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746436.544320:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788746436.544336:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746436.544342:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.544375:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875636163548416:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746436.544380:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746436.544392:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746436.544416:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163548544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.544448:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875636163548544:12345-0@lo:400:kworker.0 Request processed in 50us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746436.544454:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788746436.544504:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875636163548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.544699:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875636163548544:0@lo:400:kworker.0 00000100:00100000:1.0:1788746436.544717:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875636163548416:0@lo:400:kworker.0 00000100:00100000:2.0:1788746436.545433:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548288 00000100:00100000:2.0:1788746436.545441:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548288 00000100:00100000:2.0:1788746436.545565:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788746436.545577:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163548288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746436.545646:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163548288:12345-0@lo:400:kworker.0 Request processed in 72us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746436.545654:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746436.545691:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd450080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163548288:0@lo:400:kworker.0 00000100:00080000:2.0:1788746436.545692:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746436.545698:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788746436.574508:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 19c3ee62-be91-41d0-96d8-f823f5b214e5 00010000:00010000:0.0:1788746437.052643:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746437.122955:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 19c3ee62-be91-41d0-96d8-f823f5b214e5 00000100:00100000:2.0:1788746437.656526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656785:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656825:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656849:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656888:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656912:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746437.656934:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537280 00000100:00100000:2.0:1788746437.656942:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537280 00000100:00100000:2.0:1788746437.656990:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537792 00000100:00100000:2.0:1788746437.656993:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537792 00000100:00100000:2.0:1788746437.657006:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537408 00000100:00100000:2.0:1788746437.657009:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537408 00000100:00100000:2.0:1788746437.657032:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537664 00000100:00100000:2.0:1788746437.657034:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537664 00000100:00100000:2.0:1788746437.657051:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:2.0:1788746437.657061:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2350:x1875636141537280:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746437.657141:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2350:x1875636141537280:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746437.657150:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:2.0:1788746437.657168:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:2.0:1788746437.657175:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2350:x1875636141537792:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746437.657199:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2350:x1875636141537792:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746437.657204:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:2.0:1788746437.657226:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:2.0:1788746437.657232:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2350:x1875636141537408:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746437.657253:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2350:x1875636141537408:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 21us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746437.657259:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:2.0:1788746437.657270:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:2.0:1788746437.657276:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2350:x1875636141537664:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746437.657297:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2350:x1875636141537664:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 21us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746437.657302:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00080000:2.0:1788746437.657321:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746437.657324:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746437.659965:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537024 00000100:00100000:1.0:1788746437.659977:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537024 00000100:00100000:1.0:1788746437.660015:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537536 00000100:00100000:1.0:1788746437.660031:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537536 00000100:00100000:1.0:1788746437.660086:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537152 00000100:00100000:1.0:1788746437.660089:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537152 00000100:00100000:1.0:1788746437.660112:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746437.660121:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2350:x1875636141537536:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746437.660189:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2350:x1875636141537536:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 69us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746437.660196:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:1.0:1788746437.660288:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:1.0:1788746437.660297:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:2350:x1875636141537152:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746437.660325:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+6:2350:x1875636141537152:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 30us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746437.660331:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00080000:1.0:1788746437.660357:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746437.660384:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 104 00000100:00100000:1.0:1788746437.660391:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:2350:x1875636141537024:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746437.660438:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:2350:x1875636141537024:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 46us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746437.660444:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 104 00010000:00010000:2.0:1788746438.075037:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746438.075214:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746438.075278:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746438.075451:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163548800 00000100:00100000:2.0:1788746438.075459:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163548800 00000100:00100000:2.0:1788746438.075511:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746438.075530:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163548800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746438.075565:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788746438.075610:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163548800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746438.075617:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788746438.075710:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746438.075743:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163548800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788746439.104602:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788746439.182573:0:16464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff332e9df0 20000000:00000080:0.0:1788746439.182591:0:16464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cd347100400 uarg=0000000000000000 20000000:01000000:0.0:1788746439.182627:0:16464:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788746439.182633:0:16464:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788746439.182637:0:16464:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788746439.183802:0:16465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788746439.183990:0:16464:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788746439.191818:0:16464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746439.192075:0:16464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192096:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192104:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192110:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192119:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192126:0:16464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192133:0:16464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192176:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192221:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 12 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.192236:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163548928:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746439.192345:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192354:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.192363:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549056:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746439.192390:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192433:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.192443:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549184:0@lo:104: 00000100:00100000:2.0:1788746439.192479:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746439.192526:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192535:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 18 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.192543:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549312:0@lo:104: 00000100:00100000:2.0:1788746439.192565:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746439.192602:0:16464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.192610:0:16464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 18 pid: 14344 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.192618:0:16464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549440:0@lo:104: 00000100:00100000:2.0:1788746439.192641:0:16464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746439.192651:0:16464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746439.193079:0:14334:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788746439.193099:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549184 00000100:00100000:1.0:1788746439.193105:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549184 00000100:00100000:1.0:1788746439.193140:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549312 00000100:00100000:1.0:1788746439.193142:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549312 00000100:00100000:1.0:1788746439.193152:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549440 00000100:00100000:1.0:1788746439.193154:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549440 00000100:00100000:1.0:1788746439.193166:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746439.193174:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:16464:x1875636163549184:12345-0@lo:104: 00010000:00010000:1.0:1788746439.193186:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193252:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746439.193258:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+5:16464:x1875636163549184:12345-0@lo:104: Request processed in 86us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.193264:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746439.193282:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746439.193289:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+4:16464:x1875636163549312:12345-0@lo:104: 00010000:00010000:1.0:1788746439.193296:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193337:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788746439.193343:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+4:16464:x1875636163549312:12345-0@lo:104: Request processed in 56us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.193349:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746439.193361:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746439.193367:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:16464:x1875636163549440:12345-0@lo:104: 00010000:00010000:1.0:1788746439.193374:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193444:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788746439.193449:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+3:16464:x1875636163549440:12345-0@lo:104: Request processed in 83us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.193455:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788746439.193495:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788746439.193501:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193509:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746439.193512:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193521:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746439.193529:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746439.193534:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746439.193567:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193574:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746439.193594:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193601:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45c00/0xe59b64da5b30abc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30abd0 expref: -99 pid: 15749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193624:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746439.193628:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193633:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45000 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746439.193637:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193644:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746439.193651:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746439.193656:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746439.193670:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193675:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746439.193681:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193688:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd448f45000/0xe59b64da5b30aa8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa95 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193696:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746439.193699:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193715:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030400 already unused, calling callback (ffffffffc1b71c20) 10000000:00010000:1.0:1788746439.193718:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193724:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746439.193730:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746439.193735:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788746439.193748:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193754:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746439.193768:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193775:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.124@tcp lock: ffff9cd440030400/0xe59b64da5b30aa41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe59b64da5b30aa48 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.193789:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746439.193790:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746439.193792:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746439.193814:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163549568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746439.193848:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746439.193875:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746439.193880:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163549696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746439.193911:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746439.193940:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163549824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746439.193963:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746439.193996:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549568 00000100:00100000:1.0:1788746439.194001:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549568 00010000:00010000:1.0:1788746439.194041:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 19 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746439.194056:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549696 00000100:00100000:1.0:1788746439.194059:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549696 00010000:00010000:1.0:1788746439.194070:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 20 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746439.194080:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549824 00000100:00100000:1.0:1788746439.194082:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549824 00010000:00010000:1.0:1788746439.194091:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 21 pid: 14344 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746439.194102:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746439.194108:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+21:3316:x1875636163549568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746439.194117:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746439.194122:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 21 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194131:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 21 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194145:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746439.194175:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+21:3316:x1875636163549568:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.194191:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746439.194204:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746439.194210:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+20:3316:x1875636163549696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746439.194218:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746439.194222:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 20 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194229:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 20 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194238:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746439.194260:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+20:3316:x1875636163549696:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.194266:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746439.194279:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746439.194285:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4801b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3314:x1875636163549824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746439.194292:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746439.194296:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 19 pid: 14344 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194303:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 19 pid: 14344 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746439.194311:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746439.194336:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4801b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3314:x1875636163549824:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746439.194341:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746439.194416:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3314:1875636163549824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746439.194452:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163549696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746439.194459:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3316:1875636163549568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746439.194675:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746439.199074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746439.199110:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746439.199444:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163548928:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746439.199460:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549056:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746439.199474:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd47d1f9c00/0xe59b64da5b30abd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30abc9 expref: 18 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.199492:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549184:0@lo:104: 00010000:00010000:2.0:1788746439.199502:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd47d1f8200/0xe59b64da5b30aa95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30aa8e expref: 17 pid: 14345 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.199510:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549312:0@lo:104: 00010000:00010000:2.0:1788746439.199520:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd477401c00/0xe59b64da5b30aa48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe59b64da5b30aa41 expref: 16 pid: 14344 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746439.199533:0:16464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16464:1875636163549440:0@lo:104: 00010000:00010000:2.0:1788746439.199583:0:16464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746439.199699:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141537920 00000100:00100000:3.0:1788746439.199708:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141537920 00010000:00010000:3.0:1788746439.199741:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 13 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746439.199776:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538048 00000100:00100000:3.0:1788746439.199779:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538048 00010000:00010000:3.0:1788746439.199791:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 14 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746439.199805:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:3.0:1788746439.199812:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c9d994d-3b44-470f-b59f-3309d681526d+14:2349:x1875636141537920:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746439.199841:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746439.199847:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 14 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.199859:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 14 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.199876:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b65b expref: 14 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.199889:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746439.199943:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c9d994d-3b44-470f-b59f-3309d681526d+13:2349:x1875636141537920:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 130us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746439.199950:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:3.0:1788746439.199969:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:3.0:1788746439.199976:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c9d994d-3b44-470f-b59f-3309d681526d+12:2349:x1875636141538048:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746439.199983:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746439.199999:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200009:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200028:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd441478e00/0xe59b64da5b30acef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b5f9 expref: 12 pid: 14343 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200039:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200056:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200073:0:14337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200079:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200086:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200094:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200100:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746439.200104:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200112:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200123:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746439.200132:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746439.200153:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c9d994d-3b44-470f-b59f-3309d681526d+11:2349:x1875636141538048:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 178us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746439.200160:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00010000:00010000:2.0:1788746439.200696:0:16464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.200718:0:16464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746439.200725:0:16464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.123520:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788746440.510357:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788746440.510364:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd4585cb000 from 10 10000000:01000000:2.0:1788746440.510369:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746440.510432:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510444:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510455:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746440.510481:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163549952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.510549:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746440.510594:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746440.510615:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163549952 00000100:00100000:2.0:1788746440.510621:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163549952 00000100:00100000:2.0:1788746440.510663:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788746440.510671:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+16:14347:x1875636163549952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746440.510683:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746440.510694:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f44000/0xe59b64da5b30ad5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30ad58 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510727:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f44000/0xe59b64da5b30ad5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30ad58 expref: 17 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510737:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f44000/0xe59b64da5b30ad5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30ad58 expref: 17 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510746:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44000, rc 0) 00000100:00100000:2.0:1788746440.510783:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163549952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.510790:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788746440.510834:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163549952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746440.510846:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad5f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.510855:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30ad5f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746440.510905:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.510930:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746440.510945:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746440.510956:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550080 00000100:00100000:2.0:1788746440.510972:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550080 00000100:00100000:2.0:1788746440.511183:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788746440.511191:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163550080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.511507:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163550080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.511537:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788746440.511573:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.511607:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.511647:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746440.511662:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd467c95cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746440.511674:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550208 00000100:00100000:2.0:1788746440.511679:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550208 00000100:00100000:2.0:1788746440.511702:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788746440.511711:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163550208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.511852:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163550208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.511860:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788746440.511898:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788746440.512949:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788746440.515365:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788746440.515425:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746440.515437:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad5f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746440.515468:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd448f45400/0xe59b64da5b30ad58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad5f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746440.515479:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746440.515482:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd476f8a000 from 10 10000000:01000000:0.0:1788746440.515485:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746440.515519:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746440.515526:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746440.515536:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746440.515558:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f798e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746440.515631:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746440.515677:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746440.515838:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550336 00000100:00100000:2.0:1788746440.515846:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550336 00000100:00100000:2.0:1788746440.515898:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788746440.515909:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+17:14347:x1875636163550336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746440.515926:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746440.515939:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30ad66 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.515963:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30ad66 expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.515985:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45800/0xe59b64da5b30ad6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30ad66 expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.515994:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45800, rc 0) 00000100:00100000:2.0:1788746440.516051:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.516058:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788746440.516120:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f798e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746440.516137:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad6d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.516147:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30ad6d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746440.516203:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746440.516363:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746440.516464:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44eba70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746440.519797:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550464 00000100:00100000:2.0:1788746440.519813:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550464 00000100:00100000:2.0:1788746440.519920:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788746440.519931:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.520355:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 425us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.520365:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788746440.526039:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746440.526118:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.531611:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746440.531664:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746440.531718:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550592 00000100:00100000:1.0:1788746440.531726:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550592 00000100:00100000:1.0:1788746440.531782:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788746440.531792:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746440.531980:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.531988:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788746440.532052:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746440.533003:0:16517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788746440.534360:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788746440.534391:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746440.534416:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad6d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746440.534429:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd47d1f9600/0xe59b64da5b30ad66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad6d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746440.534439:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788746440.534441:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cd448410800 from 10 10000000:01000000:3.0:1788746440.534444:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746440.534491:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746440.534502:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746440.534511:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746440.534533:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788746440.534589:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746440.534628:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788746440.536717:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550720 00000100:00100000:1.0:1788746440.536730:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550720 00000100:00100000:1.0:1788746440.536787:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788746440.536807:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47ebc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+18:14347:x1875636163550720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746440.536822:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746440.536839:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441478a00/0xe59b64da5b30ad7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe59b64da5b30ad74 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.536867:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441478a00/0xe59b64da5b30ad7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe59b64da5b30ad74 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.536877:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441478a00/0xe59b64da5b30ad7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe59b64da5b30ad74 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.536886:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478a00, rc 0) 00000100:00100000:1.0:1788746440.536959:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47ebc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163550720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.536967:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788746440.537063:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746440.537087:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad7b expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746440.537109:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe59b64da5b30ad7b expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746440.537193:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746440.537246:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746440.537284:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788746440.537953:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550848 00000100:00100000:0.0:1788746440.537961:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550848 00000100:00100000:0.0:1788746440.538005:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788746440.538025:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163550848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746440.539258:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163550848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1232us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746440.539268:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788746440.542069:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.542145:0:14347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.542223:0:14347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746440.542505:0:14347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444c4fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746440.542526:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163550976 00000100:00100000:1.0:1788746440.542535:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163550976 00000100:00100000:1.0:1788746440.542595:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788746440.542606:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163550976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746440.542791:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:14347:x1875636163550976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.542799:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788746440.543055:0:14347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d76d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ea63f15-cd19-459c-bd52-18aa65dbbcba:14347:1875636163550976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788746440.547293:0:16519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788746440.547449:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788746440.547472:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746440.547482:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad7b expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746440.547492:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.124@tcp lock: ffff9cd440030600/0xe59b64da5b30ad74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe59b64da5b30ad7b expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746440.728169:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746440.728309:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538176 00000100:00100000:1.0:1788746440.728318:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538176 00000100:00100000:1.0:1788746440.728376:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:1.0:1788746440.728386:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+11:13733:x1875636141538176:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746440.728437:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746440.728467:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b68c expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.728497:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b68c expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.728509:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd441479200/0xe59b64da5b30ad82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b68c expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746440.728518:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479200, rc 0) 00000100:00100000:1.0:1788746440.728565:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538176:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 180us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.728572:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 114 00000100:00100000:0.0:1788746440.730601:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746440.730695:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538304 00000100:00100000:1.0:1788746440.730704:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538304 00000100:00100000:1.0:1788746440.730756:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:1.0:1788746440.730766:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538304:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746440.731158:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538304:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 392us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.731167:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 115 00000100:00100000:0.0:1788746440.735867:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746440.735964:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538432 00000100:00100000:2.0:1788746440.735974:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538432 00000100:00100000:2.0:1788746440.736045:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:2.0:1788746440.736054:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538432:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.736279:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538432:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 226us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.736288:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 116 00000100:00100000:0.0:1788746440.742729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746440.743354:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538560 00000100:00100000:2.0:1788746440.743364:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538560 00000100:00100000:2.0:1788746440.743459:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:2.0:1788746440.743470:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+12:13733:x1875636141538560:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746440.743487:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746440.743505:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30ad89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b693 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.743533:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30ad89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b693 expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.743545:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cd448f45200/0xe59b64da5b30ad89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b693 expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746440.743555:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45200, rc 0) 00000100:00100000:2.0:1788746440.743620:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13733:x1875636141538560:12345-192.168.206.24@tcp:101:ll_cfg_requeue.0 Request processed in 151us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.743636:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 117 00000100:00100000:0.0:1788746440.746107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746440.746421:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538688 00000100:00100000:1.0:1788746440.746430:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538688 00000100:00100000:1.0:1788746440.746528:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:1.0:1788746440.746538:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+13:13733:x1875636141538688:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746440.746804:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c9d994d-3b44-470f-b59f-3309d681526d+13:13733:x1875636141538688:12345-192.168.206.24@tcp:501:ll_cfg_requeue.0 Request processed in 266us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746440.746812:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 118 00000100:00100000:3.0:1788746440.748708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746440.749222:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538816 00000100:00100000:2.0:1788746440.749385:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538816 00000100:00100000:2.0:1788746440.749445:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 119 00000100:00100000:2.0:1788746440.749455:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13733:x1875636141538816:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746440.749752:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c9d994d-3b44-470f-b59f-3309d681526d+13:13733:x1875636141538816:12345-192.168.206.24@tcp:503:ll_cfg_requeue.0 Request processed in 298us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746440.749766:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 119 00010000:00010000:3.0:1788746441.146865:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746441.658771:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746441.658806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163551104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746441.658880:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746441.658950:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551104 00000100:00100000:1.0:1788746441.658957:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551104 00000100:00100000:1.0:1788746441.659027:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746441.659037:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163551104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746441.659073:0:15038:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788746441.659096:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746441.659126:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163551104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746441.659133:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746441.659191:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163551104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746441.659780:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163551616:0@lo:400:kworker.0 00000100:00100000:2.0:1788746441.659867:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163551360:0@lo:400:kworker.0 00000100:00100000:2.0:1788746441.659906:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746441.659931:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788746441.659938:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163551232:0@lo:400:kworker.0 00000100:00100000:2.0:1788746441.659966:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746441.659990:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163551744:0@lo:400:kworker.0 00000100:00100000:2.0:1788746441.660027:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746441.660055:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551360 00000100:00100000:2.0:1788746441.660061:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551360 00000100:00100000:3.0:1788746441.660066:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163551488:0@lo:400:kworker.0 00000100:00100000:3.0:1788746441.660109:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746441.660110:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746441.660120:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163551360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746441.660160:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551232 00000100:00100000:3.0:1788746441.660165:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551232 00000100:00100000:2.0:1788746441.660170:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163551360:12345-0@lo:400:kworker.0 Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746441.660194:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788746441.660201:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3317:x1875636163551232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746441.660233:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3317:x1875636163551232:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746441.660240:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788746441.660351:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746441.660390:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163551232:0@lo:400:kworker.0 00000100:00100000:3.0:1788746441.660423:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163551360:0@lo:400:kworker.0 00000100:00100000:2.0:1788746441.660463:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746441.660572:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746441.660615:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551744 00000100:00100000:0.0:1788746441.660620:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551744 00000100:00100000:0.0:1788746441.660735:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551488 00000100:00100000:0.0:1788746441.660739:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551488 00000100:00100000:0.0:1788746441.660751:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163551616 00000100:00100000:0.0:1788746441.660753:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163551616 00000100:00100000:0.0:1788746441.660765:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746441.660770:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163551744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788746441.660793:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746441.660886:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163551744:12345-0@lo:400:kworker.0 Request processed in 114us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746441.660893:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746441.660907:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746441.660913:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163551488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746441.660947:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163551488:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746441.660952:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746441.660963:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788746441.660969:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163551616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746441.660999:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875636163551616:12345-0@lo:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746441.661015:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788746441.661155:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163551744:0@lo:400:kworker.0 00000100:00100000:3.0:1788746441.661191:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163551488:0@lo:400:kworker.0 00000100:00100000:0.0:1788746441.662161:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875636163551616:0@lo:400:kworker.0 00010000:00010000:2.0:1788746442.170892:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746442.521681:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746442.522519:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141538944 00000100:00100000:1.0:1788746442.522531:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141538944 00000100:00100000:1.0:1788746442.522662:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:1.0:1788746442.522674:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+6:14389:x1875636141538944:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746442.522693:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746442.522713:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ad90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b69a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522785:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522798:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522810:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522842:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522851:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.522858:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788746442.523148:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788746442.523736:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b30ada5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523798:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b30ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523808:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b30ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746442.523836:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746442.523840:0:14350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746442.523874:0:14350:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b30ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523885:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523892:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523899:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523915:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478200 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.523919:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523926:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523938:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:1.0:1788746442.523941:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.523945:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523951:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478200/0xe59b64da5b30ad97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523965:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.523971:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.524937:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.524944:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479000 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.524948:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.524956:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.524994:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cd444a3dc00) 00010000:00010000:1.0:1788746442.524997:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.525011:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.525018:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30ad9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.525068:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ad90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b69a expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.525082:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478800/0xe59b64da5b30ada5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b69a expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.525090:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd444a3d600) 00010000:00010000:1.0:1788746442.525092:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746442.525094:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478800, rc 0) 00000100:00100000:1.0:1788746442.525272:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+7:14389:x1875636141538944:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 2599us (3599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746442.525281:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:0.0:1788746442.540723:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746442.540795:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539200 00000100:00100000:1.0:1788746442.540805:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539200 00000100:00100000:1.0:1788746442.540866:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:1.0:1788746442.540877:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+7:14389:x1875636141539200:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746442.540895:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746442.540915:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30adac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6a1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541025:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541038:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541047:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541059:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541064:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541070:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541361:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30adc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541370:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30adc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541378:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30adc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746442.541388:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788746442.541604:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541623:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541629:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541635:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.541640:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541648:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541660:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cd444a3d600) 00010000:00010000:1.0:1788746442.541663:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.541667:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541673:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30adb3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541686:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541692:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541698:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541703:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.541712:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541718:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541726:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cd444a3d000) 00010000:00010000:1.0:1788746442.541729:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.541732:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.541738:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479a00/0xe59b64da5b30adba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.542194:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30adac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6a1 expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.542209:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479600/0xe59b64da5b30adc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6a1 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.542217:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd444a3d800) 00010000:00010000:1.0:1788746442.542219:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.542222:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479600, rc 0) 00000100:00100000:1.0:1788746442.542276:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+9:14389:x1875636141539200:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 1401us (1562us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788746442.542283:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:0.0:1788746442.545958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746442.546162:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539328 00000100:00100000:1.0:1788746442.546172:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539328 00000100:00100000:1.0:1788746442.546225:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:1.0:1788746442.546236:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+9:14389:x1875636141539328:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788746442.546929:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+9:14389:x1875636141539328:12345-192.168.206.24@tcp:59:lhsmtool_posix.0 Request processed in 692us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746442.546940:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:0.0:1788746442.604975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746442.605122:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539456 00000100:00100000:3.0:1788746442.605132:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539456 00000100:00100000:3.0:1788746442.605190:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:3.0:1788746442.605200:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+9:14395:x1875636141539456:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:3.0:1788746442.605219:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746442.605241:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30adcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6a8 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605307:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605320:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605333:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605349:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605356:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605374:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605591:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605599:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605606:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605612:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746442.605616:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605623:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605635:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:3.0:1788746442.605639:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746442.605643:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605648:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30add6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605658:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605664:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605676:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605681:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746442.605684:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605690:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605698:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cd44773e300) 00010000:00010000:3.0:1788746442.605700:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746442.605703:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605709:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30addd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605738:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30adcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6a8 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605748:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:3.0:1788746442.605751:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746442.605754:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30adcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6a8 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.605764:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd440031800, rc 0) 00000100:00100000:3.0:1788746442.605818:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+9:14395:x1875636141539456:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 619us (851us total) trans 0 rc 301/301 00000100:00100000:3.0:1788746442.605834:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:2.0:1788746442.613019:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.613164:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539584 00000100:00100000:0.0:1788746442.613175:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539584 00000100:00100000:0.0:1788746442.613228:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:0.0:1788746442.613239:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a624fde4-21fb-41bf-be92-748365f2b29a+9:14395:x1875636141539584:12345-192.168.206.24@tcp:700:lfs.0 00000100:00100000:0.0:1788746442.613320:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a624fde4-21fb-41bf-be92-748365f2b29a+9:14395:x1875636141539584:12345-192.168.206.24@tcp:700:lfs.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.613328:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:0.0:1788746442.617270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746442.617354:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539840 00000100:00100000:3.0:1788746442.617363:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539840 00000100:00100000:3.0:1788746442.617454:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00100000:3.0:1788746442.617466:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+9:14395:x1875636141539840:12345-192.168.206.24@tcp:36:lfs.0 00010000:00010000:3.0:1788746442.617515:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746442.617540:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479400/0xe59b64da5b30ad12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b623 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.617557:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:3.0:1788746442.617563:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788746442.617783:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.617797:0:14351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 5 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.617805:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.617837:0:14351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 5 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.617851:0:14351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 5 pid: 14351 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746442.617864:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14351:1875636163551872:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746442.617953:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788746442.626487:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14351:1875636163551872:192.168.206.24@tcp:104: 00010000:00010000:3.0:1788746442.626517:0:14351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746442.626685:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746442.627723:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141539968 00000100:00100000:3.0:1788746442.627734:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141539968 00010000:00010000:3.0:1788746442.627811:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 6 pid: 14351 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746442.627860:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:3.0:1788746442.627869:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:2349:x1875636141539968:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746442.627882:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746442.627889:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 6 pid: 14351 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627899:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 6 pid: 14351 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627919:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30ad4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b685 expref: 6 pid: 14351 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627933:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:3.0:1788746442.627938:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627947:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627970:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.627995:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746442.628062:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2349:x1875636141539968:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 193us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746442.628070:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00010000:00010000:3.0:1788746442.628100:0:14351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.628108:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.628128:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.628136:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.628143:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746442.629392:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788746442.629438:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629449:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629457:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629472:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746442.629477:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629484:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629497:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444a3d500) 00010000:00010000:3.0:1788746442.629500:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746442.629505:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.629511:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30ade4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788746442.629528:0:14351:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000686b0d4e reply state 00000000e09992a4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746442.629537:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788746442.629609:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+10:14395:x1875636141539840:12345-192.168.206.24@tcp:36:lfs.0 Request processed in 12144us (12345us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788746442.629618:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 19 00000100:00080000:1.0:1788746442.629901:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788746442.642275:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642293:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642300:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642306:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.642311:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642318:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642334:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cd44773e300) 00010000:00010000:1.0:1788746442.642337:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.642341:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.642348:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30adeb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746442.683373:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788746442.732835:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.732941:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540096 00000100:00100000:0.0:1788746442.732950:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540096 00000100:00100000:0.0:1788746442.733014:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:0.0:1788746442.733026:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+9:14403:x1875636141540096:12345-192.168.206.24@tcp:101:lctl.0 00010000:00010000:0.0:1788746442.733051:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746442.733077:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30adf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6af expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733141:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30adf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733155:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30adf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733165:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30adf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746442.733216:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788746442.733220:0:14350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746442.733258:0:14350:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30adf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733282:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30adf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6af expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733300:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8200/0xe59b64da5b30adf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6af expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.733307:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:0.0:1788746442.733310:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746442.733315:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f8200, rc 0) 00000100:00100000:0.0:1788746442.733378:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+10:14403:x1875636141540096:12345-192.168.206.24@tcp:101:lctl.0 Request processed in 355us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.733394:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 20 00000100:00100000:2.0:1788746442.776455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.776494:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.776532:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.776565:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.776588:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.776612:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540352 00000100:00100000:1.0:1788746442.776621:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540224 00000100:00100000:2.0:1788746442.776622:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540352 00000100:00100000:1.0:1788746442.776629:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540224 00000100:00100000:2.0:1788746442.776672:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540608 00000100:00100000:2.0:1788746442.776677:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540608 00000100:00100000:1.0:1788746442.776681:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:1.0:1788746442.776694:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:2349:x1875636141540224:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746442.776713:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540480 00000100:00100000:2.0:1788746442.776717:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540480 00000100:00100000:2.0:1788746442.776731:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540736 00000100:00100000:2.0:1788746442.776734:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540736 00000100:00100000:2.0:1788746442.776749:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:2.0:1788746442.776758:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2349:x1875636141540352:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:1.0:1788746442.776765:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c9d994d-3b44-470f-b59f-3309d681526d+13:2349:x1875636141540224:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.776780:0:15034:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788746442.776786:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 121 00000100:00100000:0.0:1788746442.776789:0:15034:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788746442.776792:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2349:x1875636141540352:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746442.776801:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:2.0:1788746442.776823:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:2.0:1788746442.776829:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2349:x1875636141540608:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746442.776853:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2349:x1875636141540608:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746442.776859:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:2.0:1788746442.776880:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:2.0:1788746442.776887:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2349:x1875636141540480:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:0.0:1788746442.776891:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:0.0:1788746442.776898:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2349:x1875636141540736:12345-192.168.206.24@tcp:400:kworker.0 00000100:00100000:2.0:1788746442.776910:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2349:x1875636141540480:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746442.776916:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:0.0:1788746442.776919:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:2349:x1875636141540736:12345-192.168.206.24@tcp:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.776926:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00080000:2.0:1788746442.776933:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746442.776937:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746442.787033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.787174:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540864 00000100:00100000:0.0:1788746442.787184:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540864 00000100:00100000:0.0:1788746442.787260:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:0.0:1788746442.787271:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+5:14404:x1875636141540864:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746442.787293:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746442.787313:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6b6 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787375:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30ae07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787425:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787437:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746442.787471:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788746442.787475:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746442.787497:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787519:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6b6 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787536:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9200/0xe59b64da5b30ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6b6 expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.787544:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:0.0:1788746442.787547:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746442.787551:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd47d1f9200, rc 0) 00000100:00100000:0.0:1788746442.787608:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:14404:x1875636141540864:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 339us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.787620:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 21 00000100:00100000:1.0:1788746442.799032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.799444:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141540992 00000100:00100000:2.0:1788746442.799454:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141540992 00000100:00100000:2.0:1788746442.799503:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:2.0:1788746442.799512:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+6:14404:x1875636141540992:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746442.799530:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746442.799559:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30ae0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6bd expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799617:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799630:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799643:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799657:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799665:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799671:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799811:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799820:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799827:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746442.799857:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788746442.799860:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746442.799878:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799896:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799902:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799908:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799914:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746442.799918:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799926:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799936:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:2.0:1788746442.799939:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746442.799943:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799949:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799961:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799967:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799972:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799983:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45600 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746442.799986:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.799993:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.800014:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746442.800017:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746442.800020:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.800025:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.800056:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44c00/0xe59b64da5b30ae0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6bd expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.800069:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6bd expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.800076:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746442.800078:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746442.800081:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45e00, rc 0) 00000100:00100000:2.0:1788746442.800157:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+7:14404:x1875636141540992:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 644us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746442.800164:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 22 00000100:00100000:2.0:1788746442.811021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746442.811124:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141541248 00000100:00100000:1.0:1788746442.811134:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141541248 00000100:00100000:1.0:1788746442.811189:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:1.0:1788746442.811199:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+7:14404:x1875636141541248:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746442.811228:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746442.811248:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30ae2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6c4 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746442.811339:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788746442.811492:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30ae2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6c4 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.811505:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:1.0:1788746442.811508:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746442.811512:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30ae2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6c4 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.811528:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478e00, rc 0) 00000100:00100000:1.0:1788746442.811599:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+8:14404:x1875636141541248:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 401us (595us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788746442.811606:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 23 00000100:00100000:3.0:1788746442.816384:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.816522:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141541504 00000100:00100000:0.0:1788746442.816532:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141541504 00000100:00100000:0.0:1788746442.816584:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 24 00000100:00100000:0.0:1788746442.816594:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+8:14404:x1875636141541504:12345-192.168.206.24@tcp:36:lfs.0 00010000:00010000:0.0:1788746442.816644:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746442.816669:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45e00/0xe59b64da5b30ae23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6bd expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.816686:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:0.0:1788746442.816696:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746442.816718:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.816730:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.816741:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746442.816925:0:14351:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005f8ae0b8 reply state 00000000bc5ff589 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746442.816934:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788746442.816941:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788746442.817032:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:19c3ee62-be91-41d0-96d8-f823f5b214e5+9:14404:x1875636141541504:12345-192.168.206.24@tcp:36:lfs.0 Request processed in 439us (656us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788746442.817039:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 24 00010000:00010000:2.0:1788746442.820940:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.820957:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.820964:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.820970:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746442.820986:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.820993:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.821019:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444412900) 00010000:00010000:2.0:1788746442.821024:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788746442.821028:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.821035:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746442.828705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.828808:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141541760 00000100:00100000:0.0:1788746442.828817:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141541760 00000100:00100000:0.0:1788746442.828873:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:0.0:1788746442.828883:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+8:14404:x1875636141541760:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746442.829127:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+9:14404:x1875636141541760:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 244us (432us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788746442.829134:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:3.0:1788746442.832538:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.832639:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542016 00000100:00100000:2.0:1788746442.832649:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542016 00000100:00100000:2.0:1788746442.832714:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:2.0:1788746442.832724:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+9:14404:x1875636141542016:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:2.0:1788746442.832749:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746442.832770:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6cb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832859:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832873:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832883:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832897:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832904:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.832911:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746442.833016:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788746442.833097:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833105:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833111:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833127:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746442.833132:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833149:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833161:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:2.0:1788746442.833164:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746442.833169:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833174:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30ae46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833188:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833770:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833783:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833788:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746442.833791:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833798:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833807:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746442.833810:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746442.833813:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.833831:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30ae4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.836564:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6cb expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.836605:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:3.0:1788746442.836608:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746442.836613:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45600/0xe59b64da5b30ae3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6cb expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746442.836630:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45600, rc 0) 00000100:00100000:3.0:1788746442.836711:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd48001ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+10:14404:x1875636141542016:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 3986us (4181us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788746442.836720:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 25 00000100:00100000:3.0:1788746442.844080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746442.844230:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542144 00000100:00100000:1.0:1788746442.844240:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542144 00000100:00100000:1.0:1788746442.844301:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:1.0:1788746442.844311:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+10:14404:x1875636141542144:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:1.0:1788746442.844339:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746442.844364:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30ae5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6d2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844488:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844501:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844513:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746442.844536:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788746442.844539:0:14350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788746442.844557:0:14350:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844584:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30ae5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844604:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.844633:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444a3d000) 00010000:00010000:1.0:1788746442.844636:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746442.844640:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478000, rc 0) 00000100:00100000:1.0:1788746442.844698:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+11:14404:x1875636141542144:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 388us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746442.844705:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 26 00000100:00100000:0.0:1788746442.853756:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746442.853836:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542272 00000100:00100000:3.0:1788746442.853845:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542272 00000100:00100000:3.0:1788746442.853901:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:3.0:1788746442.853912:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+11:14404:x1875636141542272:12345-192.168.206.24@tcp:37:lfs.0 00000100:00100000:0.0:1788746442.867356:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:19c3ee62-be91-41d0-96d8-f823f5b214e5+11:14404:x1875636141542272:12345-192.168.206.24@tcp:37:lfs.0 Request processed in 13436us (13600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.867370:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:0.0:1788746442.882047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.882282:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542528 00000100:00100000:2.0:1788746442.882296:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542528 00000100:00100000:2.0:1788746442.882361:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:2.0:1788746442.882372:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+11:14404:x1875636141542528:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:2.0:1788746442.885357:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+12:14404:x1875636141542528:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 2976us (3314us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788746442.885370:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746442.934750:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.935063:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542656 00000100:00100000:0.0:1788746442.935072:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542656 00000100:00100000:0.0:1788746442.935131:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:0.0:1788746442.935141:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+10:14410:x1875636141542656:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746442.935159:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746442.935179:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b30ae69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6d9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935250:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935264:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935275:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935308:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935315:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935321:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935688:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a600/0xe59b64da5b30ae7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935697:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a600/0xe59b64da5b30ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935704:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a600/0xe59b64da5b30ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746442.935729:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788746442.935732:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746442.935767:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a600/0xe59b64da5b30ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935780:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935787:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935793:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935944:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f8400 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746442.935948:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935956:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935968:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:0.0:1788746442.935971:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746442.935977:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935983:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8400/0xe59b64da5b30ae70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.935996:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936014:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936021:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936026:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd47d1f9c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746442.936029:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936082:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936100:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cd444412700) 00010000:00010000:0.0:1788746442.936102:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746442.936107:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936112:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f9c00/0xe59b64da5b30ae77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936143:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd47d1f8800/0xe59b64da5b30ae69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d9 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936156:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a600/0xe59b64da5b30ae7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d9 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.936163:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444a3d000) 00010000:00010000:0.0:1788746442.936166:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788746442.936169:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09a600, rc 0) 00000100:00100000:0.0:1788746442.936321:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+11:14410:x1875636141542656:12345-192.168.206.24@tcp:101:bash.0 Request processed in 1180us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.936329:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 27 00000100:00100000:3.0:1788746442.949691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.949783:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141542912 00000100:00100000:0.0:1788746442.949793:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141542912 00000100:00100000:0.0:1788746442.949848:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 28 00000100:00100000:0.0:1788746442.949858:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+11:14410:x1875636141542912:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746442.949878:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746442.949897:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30ae85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6e0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.950044:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.950058:0:14351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.950066:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.950098:0:14351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.950111:0:14351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 11 pid: 14350 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746442.950124:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f798380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14351:1875636163552000:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746442.950222:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd470e186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746442.952941:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746442.953054:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141543040 00000100:00100000:2.0:1788746442.953063:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141543040 00010000:00010000:2.0:1788746442.953100:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 12 pid: 14350 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746442.953134:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:2.0:1788746442.953144:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+12:2350:x1875636141543040:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746442.953157:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746442.953164:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 12 pid: 14350 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.953177:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 12 pid: 14350 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.953198:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444a3d000) 00010000:00010000:2.0:1788746442.953203:0:14336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.953225:0:14336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.953232:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746442.953252:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746442.953303:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19c3ee62-be91-41d0-96d8-f823f5b214e5+12:2350:x1875636141543040:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746442.953311:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00010000:00010000:0.0:1788746442.954359:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478000/0xe59b64da5b30ae62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6d2 expref: 11 pid: 14350 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746442.954382:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f798380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14351:1875636163552000:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746442.954449:0:14351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.954459:0:14351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.954479:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.954501:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.954511:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.954521:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955509:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955522:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955531:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746442.955543:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788746442.955565:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955572:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955579:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955585:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09bc00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746442.955597:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955605:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955616:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444a3d000) 00010000:00010000:0.0:1788746442.955619:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746442.955624:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955631:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30ae8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788746442.955642:0:14351:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f48cebf2 reply state 00000000923bd634 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746442.955651:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788746442.955685:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30ae85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 14 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955699:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 13 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.955706:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746442.955708:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788746442.955711:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b800, rc 0) 00000100:00100000:0.0:1788746442.955779:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+14:14410:x1875636141542912:12345-192.168.206.24@tcp:101:bash.0 Request processed in 5922us (6096us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788746442.955787:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 28 00010000:00010000:1.0:1788746442.958887:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958904:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958913:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958919:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ac00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746442.958923:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958931:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958946:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cd444412700) 00010000:00010000:1.0:1788746442.958949:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746442.958954:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746442.958961:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30ae93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746442.975317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.975438:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141543168 00000100:00100000:0.0:1788746442.975448:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141543168 00000100:00100000:0.0:1788746442.975506:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:0.0:1788746442.975522:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+13:14410:x1875636141543168:12345-192.168.206.24@tcp:101:bash.0 00010000:00010000:0.0:1788746442.975549:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746442.975571:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aea8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975772:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975787:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975798:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746442.975834:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788746442.975838:0:14349:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746442.975854:0:14349:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975875:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975897:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aea8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 15 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975914:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746442.975938:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746442.975940:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788746442.975944:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09bc00, rc 0) 00000100:00100000:0.0:1788746442.976014:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+14:14410:x1875636141543168:12345-192.168.206.24@tcp:101:bash.0 Request processed in 498us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746442.976021:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 29 00000100:00100000:3.0:1788746442.979812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746442.979883:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141543424 00000100:00100000:0.0:1788746442.979893:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141543424 00000100:00100000:0.0:1788746442.979947:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:0.0:1788746442.979958:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+14:14410:x1875636141543424:12345-192.168.206.24@tcp:35:bash.0 00000100:00100000:0.0:1788746442.980563:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+15:14410:x1875636141543424:12345-192.168.206.24@tcp:35:bash.0 Request processed in 605us (756us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788746442.980571:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:3.0:1788746443.084721:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.084828:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141543680 00000100:00100000:0.0:1788746443.084837:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141543680 00000100:00100000:0.0:1788746443.084898:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:0.0:1788746443.084908:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+15:14420:x1875636141543680:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746443.084930:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.084949:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aeb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6ee expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746443.085057:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788746443.085166:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aeb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6ee expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.085197:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd444412000) 00010000:00010000:0.0:1788746443.085200:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788746443.085206:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aeb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6ee expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.085220:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09ae00, rc 0) 00000100:00100000:0.0:1788746443.085277:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+16:14420:x1875636141543680:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 370us (563us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788746443.085284:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 30 00000100:00100000:3.0:1788746443.087898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.090479:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141543936 00000100:00100000:0.0:1788746443.090494:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141543936 00000100:00100000:0.0:1788746443.090636:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:0.0:1788746443.090648:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+16:14420:x1875636141543936:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:0.0:1788746443.090892:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+17:14420:x1875636141543936:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 245us (3002us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788746443.090901:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:3.0:1788746443.135649:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.135800:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141544192 00000100:00100000:0.0:1788746443.135809:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141544192 00000100:00100000:0.0:1788746443.135875:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:0.0:1788746443.135886:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+17:14423:x1875636141544192:12345-192.168.206.24@tcp:101:lfs.0 00010000:00010000:0.0:1788746443.135907:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.135927:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aec4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6f5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.136030:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30aecb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.136056:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30aecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.136068:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30aecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746443.136081:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788746443.136204:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30aec4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6f5 expref: 20 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.136224:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30aecb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6f5 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.136232:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746443.136234:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788746443.136238:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b400, rc 0) 00000100:00100000:0.0:1788746443.136299:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+19:14423:x1875636141544192:12345-192.168.206.24@tcp:101:lfs.0 Request processed in 415us (657us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788746443.136307:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 31 00000100:00100000:3.0:1788746443.142797:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746443.142843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.142943:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141544320 00000100:00100000:1.0:1788746443.142952:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141544320 00000100:00100000:1.0:1788746443.143028:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:1.0:1788746443.143039:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+19:14423:x1875636141544320:12345-192.168.206.24@tcp:54:lfs.0 00010000:00010000:1.0:1788746443.143113:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143138:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143150:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143175:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143182:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143189:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143195:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746443.143199:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143205:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143214:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:1.0:1788746443.143242:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746443.143248:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.143254:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aed9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746443.143324:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+19:14423:x1875636141544320:12345-192.168.206.24@tcp:54:lfs.0 Request processed in 286us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.143652:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 32 00000100:00100000:2.0:1788746443.143960:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141544448 00000100:00100000:2.0:1788746443.143965:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141544448 00000100:00100000:2.0:1788746443.144019:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:2.0:1788746443.144027:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+19:2347:x1875636141544448:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746443.144038:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746443.144063:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30aecb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6f5 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.144076:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:2.0:1788746443.144079:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746443.144118:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+18:2347:x1875636141544448:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 91us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.144125:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:3.0:1788746443.146176:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.146343:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141544704 00000100:00100000:2.0:1788746443.146351:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141544704 00000100:00100000:2.0:1788746443.146395:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:2.0:1788746443.146425:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a624fde4-21fb-41bf-be92-748365f2b29a+18:14423:x1875636141544704:12345-192.168.206.24@tcp:35:lfs.0 00000100:00100000:2.0:1788746443.146640:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a624fde4-21fb-41bf-be92-748365f2b29a+19:14423:x1875636141544704:12345-192.168.206.24@tcp:35:lfs.0 Request processed in 216us (469us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788746443.146648:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:3.0:1788746443.194845:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163552128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746443.194911:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746443.195166:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163552128 00000100:00100000:0.0:1788746443.195174:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163552128 00000100:00100000:0.0:1788746443.195243:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746443.195253:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163552128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746443.195287:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788746443.195335:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163552128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.195342:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788746443.195456:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163552128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788746443.195568:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788746443.195622:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746443.531900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.532009:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141544960 00000100:00100000:1.0:1788746443.532019:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141544960 00000100:00100000:1.0:1788746443.532083:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:1.0:1788746443.532094:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+19:14454:x1875636141544960:12345-192.168.206.24@tcp:101:cat.0 00010000:00010000:1.0:1788746443.532115:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746443.532133:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aee0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b6fc expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.532217:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30aee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.532231:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30aee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.532242:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30aee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746443.532253:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788746443.532669:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478e00/0xe59b64da5b30aee0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6fc expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.532706:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30aee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6fc expref: 21 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.532714:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:1.0:1788746443.532716:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746443.532720:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479000, rc 0) 00000100:00100000:1.0:1788746443.532779:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+21:14454:x1875636141544960:12345-192.168.206.24@tcp:101:cat.0 Request processed in 687us (887us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788746443.532786:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 33 00000100:00100000:3.0:1788746443.537823:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.537905:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141545344 00000100:00100000:0.0:1788746443.537914:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141545344 00000100:00100000:0.0:1788746443.537974:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:0.0:1788746443.537985:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+21:14454:x1875636141545344:12345-192.168.206.24@tcp:35:cat.0 00000100:00100000:0.0:1788746443.538324:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+22:14454:x1875636141545344:12345-192.168.206.24@tcp:35:cat.0 Request processed in 339us (509us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788746443.538344:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 8 00000100:00100000:3.0:1788746443.539258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.539449:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141545088 00000100:00100000:2.0:1788746443.539458:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141545088 00000100:00100000:2.0:1788746443.539511:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:2.0:1788746443.539521:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a624fde4-21fb-41bf-be92-748365f2b29a+22:2347:x1875636141545088:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746443.539535:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746443.539556:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479000/0xe59b64da5b30aee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6fc expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.539574:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:2.0:1788746443.539579:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746443.539621:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a624fde4-21fb-41bf-be92-748365f2b29a+21:2347:x1875636141545088:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 101us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.539628:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:1.0:1788746443.627496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.627590:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141545600 00000100:00100000:0.0:1788746443.627599:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141545600 00000100:00100000:0.0:1788746443.627656:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:0.0:1788746443.627666:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+21:14460:x1875636141545600:12345-192.168.206.24@tcp:101:dd.0 00010000:00010000:0.0:1788746443.627688:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.627707:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30aef5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b703 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627795:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627809:0:14350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627818:0:14350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 22 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627826:0:14350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627870:0:14350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 22 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.627884:0:14350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 22 pid: 14349 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.627896:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163552256:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746443.631154:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.631523:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141545728 00000100:00100000:1.0:1788746443.631532:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141545728 00010000:00010000:1.0:1788746443.631569:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 6/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 23 pid: 14349 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746443.631611:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:1.0:1788746443.631621:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd4801b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+23:2350:x1875636141545728:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746443.631634:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746443.631640:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 6/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 23 pid: 14349 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.631652:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 23 pid: 14349 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.631673:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:1.0:1788746443.631689:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.631697:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.631703:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746443.631749:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd4801b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+23:2350:x1875636141545728:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 129us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.631756:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00010000:00010000:0.0:1788746443.632014:0:14350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.632026:0:14350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.632039:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163552384:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746443.632096:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd470e186c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788746443.632119:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30aeaf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e7 expref: 22 pid: 14349 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.632134:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163552256:192.168.206.24@tcp:104: 00000100:00100000:3.0:1788746443.636713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.637144:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163552384:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746443.637173:0:14350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746443.637356:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141545856 00000100:00100000:1.0:1788746443.637364:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141545856 00010000:00010000:1.0:1788746443.637435:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746443.637477:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:1.0:1788746443.637487:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+22:2349:x1875636141545856:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746443.637501:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746443.637509:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637521:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637542:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30ae9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b6e0 expref: 22 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637558:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:1.0:1788746443.637576:0:14335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637586:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637593:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.637617:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746443.637665:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+21:2349:x1875636141545856:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 178us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.637673:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00010000:00010000:0.0:1788746443.637840:0:14350:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.637857:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746443.637875:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788746443.638047:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30aef5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b703 expref: 22 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.638064:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09a400/0xe59b64da5b30aefc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b703 expref: 21 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.638072:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746443.638074:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788746443.638077:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09a400, rc 0) 00000100:00100000:0.0:1788746443.638104:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+21:14460:x1875636141545600:12345-192.168.206.24@tcp:101:dd.0 Request processed in 10440us (10708us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788746443.638111:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 34 00000100:00100000:1.0:1788746443.640629:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.640734:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546112 00000100:00100000:0.0:1788746443.640743:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546112 00000100:00100000:0.0:1788746443.640793:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 35 00000100:00100000:0.0:1788746443.640801:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+21:14460:x1875636141546112:12345-192.168.206.24@tcp:36:dd.0 00010000:00010000:0.0:1788746443.641067:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.641082:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.641093:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746443.641162:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788746443.641192:0:14349:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a41c1b15 reply state 000000000a0f2ec9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.641200:0:14349:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788746443.641280:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+24:14460:x1875636141546112:12345-192.168.206.24@tcp:36:dd.0 Request processed in 478us (659us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788746443.641287:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 35 00000020:00080000:0.0:1788746443.641291:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788746443.643908:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643925:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643933:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643939:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09bc00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746443.643944:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643951:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643966:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:3.0:1788746443.643969:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746443.643974:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746443.643980:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30af0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746443.644340:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.644435:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546240 00000100:00100000:0.0:1788746443.644443:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546240 00000100:00100000:0.0:1788746443.644489:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:0.0:1788746443.644500:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+23:14460:x1875636141546240:12345-192.168.206.24@tcp:101:dd.0 00010000:00010000:0.0:1788746443.644520:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.644537:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b70a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.644590:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b70a expref: 24 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.644603:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b70a expref: 24 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.644620:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746443.644622:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746443.644625:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b800, rc 0) 00000100:00100000:0.0:1788746443.644674:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+24:14460:x1875636141546240:12345-192.168.206.24@tcp:101:dd.0 Request processed in 176us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.644689:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 36 00000100:00100000:2.0:1788746443.656742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.656826:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546496 00000100:00100000:1.0:1788746443.656835:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546496 00000100:00100000:1.0:1788746443.656892:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:1.0:1788746443.656901:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a624fde4-21fb-41bf-be92-748365f2b29a+24:14460:x1875636141546496:12345-192.168.206.24@tcp:103:dd.0 00010000:00010000:1.0:1788746443.656915:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746443.656936:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b70a expref: 24 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.656955:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:1.0:1788746443.656959:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746443.657023:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a624fde4-21fb-41bf-be92-748365f2b29a+23:14460:x1875636141546496:12345-192.168.206.24@tcp:103:dd.0 Request processed in 122us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.657030:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:1.0:1788746443.659911:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.663601:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546624 00000100:00100000:0.0:1788746443.663617:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546624 00000100:00100000:0.0:1788746443.663686:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:0.0:1788746443.663696:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+23:14460:x1875636141546624:12345-192.168.206.24@tcp:58:dd.0 00010000:00010000:0.0:1788746443.663781:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.663797:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.663808:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746443.664607:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746443.664752:0:14351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788746443.664818:0:14351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788746443.664925:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+23:14460:x1875636141546624:12345-192.168.206.24@tcp:58:dd.0 Request processed in 1228us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.664935:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 37 00000100:00100000:3.0:1788746443.666957:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.667272:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546752 00000100:00100000:0.0:1788746443.667281:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546752 00000100:00100000:0.0:1788746443.667336:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 38 00000100:00100000:0.0:1788746443.667346:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+23:14460:x1875636141546752:12345-192.168.206.24@tcp:101:dd.0 00010000:00010000:0.0:1788746443.667363:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.667381:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b711 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667485:0:14349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667495:0:14349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 24 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667512:0:14349:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667524:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 24 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667537:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746443.667540:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746443.667543:0:14349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 24 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.667550:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09b400, rc 0) 00000100:00100000:0.0:1788746443.667606:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+24:14460:x1875636141546752:12345-192.168.206.24@tcp:101:dd.0 Request processed in 261us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.667613:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 38 00000040:00080000:1.0:1788746443.706618:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788746443.706627:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788746443.706665:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788746443.706671:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788746443.706790:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd47d37a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1875636163552512:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788746443.706938:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd46a32bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746443.720574:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd47d37a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1875636163552512:192.168.206.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788746443.722244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.722866:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141546880 00000100:00100000:2.0:1788746443.722876:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141546880 00000100:00100000:2.0:1788746443.722933:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:2.0:1788746443.722945:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141546880:12345-192.168.206.24@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788746443.723050:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141546880:12345-192.168.206.24@tcp:900:lhsmtool_posix.0 Request processed in 107us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.723058:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:1.0:1788746443.727162:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.727264:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141547008 00000100:00100000:0.0:1788746443.727273:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141547008 00000100:00100000:0.0:1788746443.727336:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:0.0:1788746443.727346:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141547008:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788746443.727377:0:14350:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788746443.727517:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141547008:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 172us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.727525:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 39 00000100:00100000:1.0:1788746443.733353:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.733724:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141547136 00000100:00100000:0.0:1788746443.733733:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141547136 00000100:00100000:0.0:1788746443.733786:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:0.0:1788746443.733795:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141547136:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788746443.733859:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.733876:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.733888:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.733957:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.733966:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.733984:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734016:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734025:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734032:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746443.734079:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788746443.734083:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788746443.734111:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734122:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734128:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734135:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734141:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ae00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746443.734144:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734151:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734162:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd444a3d800) 00010000:00010000:0.0:1788746443.734164:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746443.734169:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734175:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734188:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734202:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734208:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734213:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ac00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746443.734217:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734737:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734752:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cd444412800) 00010000:00010000:0.0:1788746443.734755:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746443.734759:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734765:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734782:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734788:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734794:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734799:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09b800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746443.734809:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734816:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734824:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:0.0:1788746443.734827:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746443.734830:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.734836:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b800/0xe59b64da5b30af34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.736565:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141547136:12345-192.168.206.24@tcp:34:lhsmtool_posix.0 Request processed in 2762us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.736578:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 40 00000100:00100000:1.0:1788746443.750615:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746443.753195:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141547392 00000100:00100000:3.0:1788746443.753491:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141547392 00000100:00100000:2.0:1788746443.753719:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:2.0:1788746443.753732:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+24:14461:x1875636141547392:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746443.753752:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746443.753771:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30af3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b718 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.753874:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.753889:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.753900:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746443.753912:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788746443.754145:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754152:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754158:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754163:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746443.754167:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754174:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754202:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:2.0:1788746443.754205:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788746443.754221:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754242:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754285:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30af3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b718 expref: 26 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754294:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cd444a3d800) 00010000:00010000:2.0:1788746443.754296:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746443.754301:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45000/0xe59b64da5b30af3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b718 expref: 26 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.754651:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f45000, rc 0) 00000100:00100000:2.0:1788746443.754835:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+25:14461:x1875636141547392:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 1105us (4228us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788746443.754843:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 41 00000100:00100000:3.0:1788746443.760720:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.760806:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141547520 00000100:00100000:0.0:1788746443.760815:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141547520 00000100:00100000:0.0:1788746443.760870:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:0.0:1788746443.760880:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+25:14461:x1875636141547520:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788746443.760933:0:14351:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788746443.761044:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+25:14461:x1875636141547520:12345-192.168.206.24@tcp:53:lhsmtool_posix.0 Request processed in 164us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.761052:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 42 00000100:00100000:0.0:1788746443.764532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.764598:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141547776 00000100:00100000:2.0:1788746443.764615:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141547776 00000100:00100000:2.0:1788746443.764666:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:2.0:1788746443.764675:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f79bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+25:14461:x1875636141547776:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746443.764696:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746443.764715:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b71f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788746443.765776:0:14349:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788746443.765784:0:14349:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788746443.765845:0:14349:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788746443.766137:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b30af57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.766152:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b30af57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.766163:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b30af57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.767168:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b71f expref: 28 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.767212:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b30af57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b71f expref: 27 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.767222:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:2.0:1788746443.767240:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746443.767244:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44200, rc 0) 00000100:00100000:2.0:1788746443.767325:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f79bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+27:14461:x1875636141547776:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 2650us (2801us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788746443.767333:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 43 00000100:00100000:1.0:1788746443.773755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.773828:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548032 00000100:00100000:0.0:1788746443.773837:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548032 00000100:00100000:0.0:1788746443.773891:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:0.0:1788746443.773902:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+27:14461:x1875636141548032:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788746443.773966:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746443.773990:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44200/0xe59b64da5b30af57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b71f expref: 27 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774017:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1acc00) 00010000:00010000:0.0:1788746443.774028:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746443.774049:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774062:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774071:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774085:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774091:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774098:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774159:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774167:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774173:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774186:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ac00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746443.774190:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774197:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774217:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cd444a3d000) 00010000:00010000:0.0:1788746443.774221:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746443.774225:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774231:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ac00/0xe59b64da5b30af65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774243:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774248:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774253:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774258:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ae00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:0.0:1788746443.774260:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774266:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774284:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa98e56a6 (ffff9cd444412800) 00010000:00010000:0.0:1788746443.774286:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746443.774289:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.774295:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa98e56a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.776243:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+26:14461:x1875636141548032:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 2333us (2488us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746443.776256:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 44 00000100:00100000:1.0:1788746443.789039:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.789125:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548160 00000100:00100000:2.0:1788746443.789135:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548160 00000100:00100000:2.0:1788746443.789192:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:2.0:1788746443.789202:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+26:14461:x1875636141548160:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746443.789245:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746443.789267:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af73 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b726 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789301:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30af7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789314:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30af7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789326:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30af7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789441:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b726 expref: 28 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789458:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44a00/0xe59b64da5b30af7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b726 expref: 27 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.789466:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746443.789469:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788746443.789473:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44a00, rc 0) 00000100:00100000:2.0:1788746443.789523:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+27:14461:x1875636141548160:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 322us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.789530:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 45 00000100:00100000:2.0:1788746443.794310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.794417:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548416 00000100:00100000:0.0:1788746443.794436:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548416 00000100:00100000:0.0:1788746443.794498:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 46 00000100:00100000:0.0:1788746443.794510:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+27:14461:x1875636141548416:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788746443.794588:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.794605:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.794617:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746443.795018:0:14350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788746443.795028:0:14350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518199629311ns, next at 519199626471ns, rc = 0 00000004:00010000:0.0:1788746443.795583:0:14350:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000115dbbfd reply state 00000000cbf40d8d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746443.795612:0:14350:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788746443.795788:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+29:14461:x1875636141548416:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 1278us (1484us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788746443.795797:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 46 00010000:00010000:1.0:1788746443.805134:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805151:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805158:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805164:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ae00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:1.0:1788746443.805168:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805175:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805190:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746443.805193:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788746443.805198:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.805219:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09ae00/0xe59b64da5b30af81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746443.805769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.806346:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548544 00000100:00100000:1.0:1788746443.806356:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548544 00000100:00100000:1.0:1788746443.806438:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:1.0:1788746443.806448:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+28:14461:x1875636141548544:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746443.806471:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746443.806490:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b72d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.806545:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 29 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.806559:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 29 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746443.806578:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746443.806581:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788746443.806584:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441478c00, rc 0) 00000100:00100000:1.0:1788746443.806637:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+29:14461:x1875636141548544:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 190us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.806643:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 47 00000100:00100000:3.0:1788746443.809814:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.809905:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548672 00000100:00100000:2.0:1788746443.809927:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548672 00000100:00100000:2.0:1788746443.809987:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:2.0:1788746443.809996:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+5:2350:x1875636141548672:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788746443.810347:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+6:2350:x1875636141548672:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 350us (539us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788746443.810355:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 12 00000100:00100000:3.0:1788746443.815465:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.815554:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141548928 00000100:00100000:0.0:1788746443.815563:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141548928 00000100:00100000:0.0:1788746443.815623:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:0.0:1788746443.815633:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+29:14461:x1875636141548928:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788746443.815852:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+30:14461:x1875636141548928:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 220us (397us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788746443.815860:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 9 00000100:00100000:3.0:1788746443.824788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.824896:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549184 00000100:00100000:2.0:1788746443.824905:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549184 00000100:00100000:2.0:1788746443.824962:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:2.0:1788746443.824972:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+30:14461:x1875636141549184:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788746443.825096:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a624fde4-21fb-41bf-be92-748365f2b29a+30:14461:x1875636141549184:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 125us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.825103:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 48 00000100:00100000:3.0:1788746443.830514:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.831071:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549312 00000100:00100000:2.0:1788746443.831081:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549312 00000100:00100000:2.0:1788746443.831136:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:2.0:1788746443.831145:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+30:14461:x1875636141549312:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746443.831162:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746443.831180:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af8f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b734 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831251:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831264:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831290:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746443.831329:0:14350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788746443.831346:0:14350:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831370:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f45c00/0xe59b64da5b30af8f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b734 expref: 32 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831388:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b734 expref: 31 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746443.831440:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746443.831444:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788746443.831448:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd448f44800, rc 0) 00000100:00100000:2.0:1788746443.831500:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+31:14461:x1875636141549312:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 356us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.831507:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 49 00000100:00100000:3.0:1788746443.834091:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.834179:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549440 00000100:00100000:0.0:1788746443.834188:0:16578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549440 00000100:00100000:0.0:1788746443.834249:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:0.0:1788746443.834259:0:16578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a624fde4-21fb-41bf-be92-748365f2b29a+6:2349:x1875636141549440:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746443.834276:0:16578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746443.834296:0:16578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b73b expref: -99 pid: 16578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746443.834336:0:16578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1acc, blocks: 0x1 00010000:00010000:0.0:1788746443.834355:0:16578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788746443.834360:0:16578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746443.834367:0:16578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.834439:0:16578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 7 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746443.834451:0:16578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd44e09ac00, rc 0) 00000100:00100000:0.0:1788746443.834502:0:16578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a624fde4-21fb-41bf-be92-748365f2b29a+7:2349:x1875636141549440:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 244us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.834508:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:3.0:1788746443.837289:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746443.849093:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549696 00000100:00100000:1.0:1788746443.849108:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549696 00000100:00100000:1.0:1788746443.849233:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:1.0:1788746443.849243:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+31:14461:x1875636141549696:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788746443.849363:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+31:14461:x1875636141549696:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 122us (12084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746443.849371:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 50 00000100:00100000:3.0:1788746443.852016:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746443.864821:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549824 00000100:00100000:2.0:1788746443.867092:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549824 00000100:00100000:2.0:1788746443.867165:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:2.0:1788746443.867175:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+31:14461:x1875636141549824:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788746443.992888:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788746443.992906:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788746443.992946:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788746443.992970:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788746443.993218:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746443.993238:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163552640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788746443.993309:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746443.993373:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163552640 00000100:00100000:0.0:1788746443.993380:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163552640 00000100:00100000:0.0:1788746443.993453:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746443.993461:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875636163552640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788746443.993604:0:15035:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788746443.993607:0:15035:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788746443.993610:0:15035:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788746443.993612:0:15035:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788746444 -> 1788746444 00002000:00010000:0.0:1788746443.993614:0:15035:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788746443.993665:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875636163552640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (355us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788746443.993672:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788746443.993694:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788746443.993723:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd45f79aa00/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788746443.993728:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f79aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875636163552640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788746443.996366:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+14:14461:x1875636141549824:12345-192.168.206.24@tcp:44:lhsmtool_posix.0 Request processed in 126999us (142172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746443.996386:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 51 00000100:00100000:1.0:1788746443.997392:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746443.997532:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141549952 00000100:00100000:0.0:1788746443.997542:0:16578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141549952 00000100:00100000:0.0:1788746443.997625:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:0.0:1788746443.997635:0:16578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a624fde4-21fb-41bf-be92-748365f2b29a+7:2350:x1875636141549952:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788746443.997777:0:16578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a624fde4-21fb-41bf-be92-748365f2b29a+7:2350:x1875636141549952:12345-192.168.206.24@tcp:16:lhsmtool_posix.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746443.997783:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:0.0:1788746444.005784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.005858:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550208 00000100:00100000:1.0:1788746444.005867:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550208 00000100:00080000:0.0:1788746444.006073:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746444.006130:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 52 00000100:00100000:1.0:1788746444.006143:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+14:14461:x1875636141550208:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788746444.006352:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746444.006380:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd448f44800/0xe59b64da5b30af96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b734 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.006419:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746444.006425:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788746444.006452:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.006465:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.006475:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788746444.006641:0:14351:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000013481df5 reply state 000000009ea49838 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746444.006664:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788746444.006757:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a624fde4-21fb-41bf-be92-748365f2b29a+15:14461:x1875636141550208:12345-192.168.206.24@tcp:36:lhsmtool_posix.0 Request processed in 617us (981us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788746444.006765:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 52 00010000:00010000:3.0:1788746444.012858:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012875:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012883:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012890:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479c00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746444.012894:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012900:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012943:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746444.012946:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746444.012952:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.012958:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441479c00/0xe59b64da5b30afa4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.014207:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.014437:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550336 00000100:00100000:1.0:1788746444.014447:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550336 00000100:00100000:1.0:1788746444.014502:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:1.0:1788746444.014513:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+7:14461:x1875636141550336:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746444.014529:0:15035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746444.014547:0:15035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c88f4e37147b742 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.014576:0:15035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.014586:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746444.014590:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746444.014596:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.014630:0:15035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.014645:0:15035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746444.014675:0:15035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15035:1875636163552768:192.168.206.24@tcp:104: 00000100:00100000:1.0:1788746444.014754:0:15035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd44756d300 going to sleep for 11 seconds 00000100:00080000:0.0:1788746444.015495:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746444.018166:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746444.018373:0:15035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15035:1875636163552768:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746444.018440:0:15035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.018460:0:15035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd441479a00, rc 0) 00000100:00100000:0.0:1788746444.018519:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a624fde4-21fb-41bf-be92-748365f2b29a+8:14461:x1875636141550336:12345-192.168.206.24@tcp:101:lhsmtool_posix.0 Request processed in 4009us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746444.018529:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 16 00000100:00100000:3.0:1788746444.018694:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550464 00000100:00100000:3.0:1788746444.018701:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550464 00010000:00010000:3.0:1788746444.018731:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.018763:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:3.0:1788746444.018773:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+8:2350:x1875636141550464:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746444.018785:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746444.018806:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.018818:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.018837:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30af9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b73b expref: 8 pid: 16578 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.018852:0:14337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.018869:0:14337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.018875:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 7 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.018884:0:14337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 7 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.018920:0:14337:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 7 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.018933:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14337:1875636163552896:192.168.206.24@tcp:105: 00000100:00100000:3.0:1788746444.018994:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788746444.022508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746444.022600:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550592 00000100:00100000:2.0:1788746444.022624:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550592 00000100:00100000:2.0:1788746444.022673:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:2.0:1788746444.022684:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a624fde4-21fb-41bf-be92-748365f2b29a+8:2350:x1875636141550592:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788746444.022858:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788746444.022862:0:15033:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788746444 00002000:00010000:2.0:1788746444.022864:0:15033:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788746443 00002000:00010000:2.0:1788746444.022866:0:15033:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788746444 -> 1788746444 00002000:00010000:2.0:1788746444.022868:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788746444.022928:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a624fde4-21fb-41bf-be92-748365f2b29a+9:2350:x1875636141550592:12345-192.168.206.24@tcp:2:lhsmtool_posix.0 Request processed in 245us (428us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788746444.022936:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 17 00000100:00100000:3.0:1788746444.023636:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14337:1875636163552896:192.168.206.24@tcp:105: 00010000:00010000:3.0:1788746444.023657:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746444.023705:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+8:2350:x1875636141550464:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 4933us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746444.023713:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 13 00000100:00100000:1.0:1788746444.039210:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746444.039381:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550720 00000100:00100000:0.0:1788746444.039391:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550720 00000100:00100000:0.0:1788746444.039471:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:0.0:1788746444.039480:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a624fde4-21fb-41bf-be92-748365f2b29a+8:2348:x1875636141550720:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788746444.039521:0:15034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.039558:0:15034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.039567:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746444.039571:0:15034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788746444.039577:0:15034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.039610:0:15034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.039625:0:15034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.039639:0:15034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15034:1875636163553024:192.168.206.24@tcp:104: 00000100:00100000:0.0:1788746444.039716:0:15034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4485b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746444.043011:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.043384:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141550848 00000100:00100000:1.0:1788746444.043394:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141550848 00010000:00010000:1.0:1788746444.043473:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 9 pid: 15035 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746444.043506:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 14 00000100:00100000:1.0:1788746444.043515:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+9:2350:x1875636141550848:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746444.043529:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746444.043551:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 9 pid: 15035 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.043565:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 9 pid: 15035 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.043589:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746444.043594:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746444.043599:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.043630:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.043651:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746444.043706:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a624fde4-21fb-41bf-be92-748365f2b29a+9:2350:x1875636141550848:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 192us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746444.043715:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 14 00010000:00010000:0.0:1788746444.045441:0:15034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62ad255/0xe59b64da5b30afab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b742 expref: 8 pid: 15035 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.045464:0:15034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45f799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15034:1875636163553024:192.168.206.24@tcp:104: 00010000:00010000:0.0:1788746444.045486:0:15034:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045496:0:15034:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045516:0:15034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045548:0:15034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045557:0:15034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045565:0:15034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045572:0:15034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ac00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746444.045576:0:15034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045584:0:15034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045599:0:15034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.045607:0:15034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032045679/0xe59b64da5b30afb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.045697:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a624fde4-21fb-41bf-be92-748365f2b29a+7:2348:x1875636141550720:12345-192.168.206.24@tcp:1:lhsmtool_posix.0 Request processed in 6216us (6493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746444.045705:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 18 00000100:00100000:2.0:1788746444.049631:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746444.049709:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551104 00000100:00100000:3.0:1788746444.049719:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551104 00000100:00100000:3.0:1788746444.049777:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 53 00000100:00100000:3.0:1788746444.049787:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+14:14461:x1875636141551104:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788746444.049864:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.049880:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.049909:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.050163:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.050302:0:14350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 15 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.050314:0:14350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.050348:0:14350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 15 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.050363:0:14350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 15 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.050378:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163553152:192.168.206.24@tcp:104: 00000100:00100000:2.0:1788746444.051191:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd444edf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788746444.054128:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163553152:192.168.206.24@tcp:104: 00010000:00010000:2.0:1788746444.054157:0:14350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746444.056057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746444.056331:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551232 00000100:00100000:3.0:1788746444.056340:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551232 00010000:00010000:3.0:1788746444.056377:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 16 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.056451:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 15 00000100:00100000:3.0:1788746444.056462:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+16:2350:x1875636141551232:12345-192.168.206.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746444.056477:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746444.056498:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 16 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056509:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 16 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056531:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd441478c00/0xe59b64da5b30af88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b72d expref: 16 pid: 14351 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056546:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:3.0:1788746444.056551:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056560:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056566:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.056593:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746444.056645:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a624fde4-21fb-41bf-be92-748365f2b29a+15:2350:x1875636141551232:12345-192.168.206.24@tcp:103:ldlm_bl.0 Request processed in 185us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746444.056652:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 15 00010000:00010000:2.0:1788746444.056995:0:14350:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.057013:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746444.057202:0:14350:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788746444.057333:0:14350:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788746444.057374:0:14350:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788746444.057507:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14350:1875636163553280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788746444.057600:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746444.057627:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd4446669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746444.058642:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163553280 00000100:00100000:3.0:1788746444.058651:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163553280 00000100:00100000:3.0:1788746444.058746:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746444.058757:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14350:x1875636163553280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788746444.058855:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14350:x1875636163553280:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746444.058878:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746444.058982:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd48001df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14350:1875636163553280:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788746444.059669:0:14350:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788746444.059750:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14350:1875636163553408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788746444.059793:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746444.061067:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746444.061124:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163553408 00000100:00100000:0.0:1788746444.061132:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163553408 00000100:00100000:0.0:1788746444.061170:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746444.061188:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14350:x1875636163553408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788746444.061565:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14350:x1875636163553408:12345-0@lo:1000:mdt00_001.0 Request processed in 387us (1770us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788746444.061584:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788746444.061857:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14350:1875636163553408:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788746444.061893:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.061903:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.061910:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.061916:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030e00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746444.061921:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.061938:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.061953:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:2.0:1788746444.061956:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746444.061961:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064113:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030e00/0xe59b64da5b30afc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064168:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064175:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064364:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064370:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09be00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:2.0:1788746444.064374:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064381:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064393:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:2.0:1788746444.064419:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746444.064428:0:14350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064440:0:14350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064449:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.064534:0:14350:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09b400/0xe59b64da5b30af1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.24@tcp remote: 0x4c88f4e37147b711 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746444.064549:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd45fb09880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163553536:192.168.206.24@tcp:105: 00000100:00100000:2.0:1788746444.064707:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cd477648b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746444.071957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746444.072193:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd45fb09880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14350:1875636163553536:192.168.206.24@tcp:105: 00010000:00010000:3.0:1788746444.072221:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072233:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09be00/0xe59b64da5b30af18 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072266:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072281:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072292:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072303:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072310:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072318:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072324:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030a00 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746444.072328:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072335:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072361:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:3.0:1788746444.072364:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788746444.072368:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072375:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440030a00/0xe59b64da5b30afc7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072386:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072393:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072432:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072439:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031800 already unused, calling callback (ffffffffc1f984f0) 00010000:00010000:3.0:1788746444.072441:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072448:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072455:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cd444412400) 00010000:00010000:3.0:1788746444.072458:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746444.072461:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.072466:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd440031800/0xe59b64da5b30afb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.072690:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd47d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a624fde4-21fb-41bf-be92-748365f2b29a+18:14461:x1875636141551104:12345-192.168.206.24@tcp:57:lhsmtool_posix.0 Request processed in 22903us (23067us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788746444.072700:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 53 00000020:00080000:3.0:1788746444.072706:0:14350:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788746444.073424:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788746444.073430:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746444.073460:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788746444.073466:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788746444.073719:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551360 00000100:00100000:1.0:1788746444.073727:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551360 00000100:00100000:1.0:1788746444.073779:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746444.073789:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f4e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+18:14460:x1875636141551360:12345-192.168.206.24@tcp:49:dd.0 00000100:00100000:1.0:1788746444.073891:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f4e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+18:14460:x1875636141551360:12345-192.168.206.24@tcp:49:dd.0 Request processed in 103us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746444.073899:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 10 00000100:00100000:1.0:1788746444.085685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:0.0:1788746444.085776:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551616 00000100:00100000:0.0:1788746444.085785:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551616 00000100:00100000:0.0:1788746444.085842:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 11 00000100:00100000:0.0:1788746444.085852:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+18:14461:x1875636141551616:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788746444.086571:0:14352:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788746444.086671:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788746444.086715:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086732:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086743:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086752:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086765:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086771:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.086787:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788746444.086877:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a624fde4-21fb-41bf-be92-748365f2b29a+20:14461:x1875636141551616:12345-192.168.206.24@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1200us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788746444.086885:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 11 00000020:00080000:0.0:1788746444.086890:0:14352:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788746444.087223:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746444.087230:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.087237:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09bc00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746444.087241:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.087248:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.087261:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cd46e1ac800) 00010000:00010000:1.0:1788746444.087271:0:14339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788746444.087276:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.087281:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd44e09bc00/0xe59b64da5b30afce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.087294:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746444.087296:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746444.087297:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746444.221102:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746444.231536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746444.231584:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.231700:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551744 00000100:00100000:1.0:1788746444.231710:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551744 00000100:00100000:1.0:1788746444.231769:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552000 00000100:00100000:1.0:1788746444.231773:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552000 00000100:00100000:1.0:1788746444.231795:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:1.0:1788746444.231804:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+8:2349:x1875636141551744:12345-192.168.206.24@tcp:4:dd.0 00002000:00010000:1.0:1788746444.231850:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9e1acc, atime: 0x6a9e1acb, ctime: 0x6a9e1acc, blocks: 0x1 00010000:00010000:1.0:1788746444.231860:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.231876:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788746444.231881:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746444.231887:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.231901:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.236573:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:2.0:1788746444.236679:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788746444.236688:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788746444.237381:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141551872 00000100:00100000:1.0:1788746444.237421:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141551872 00000100:00100000:2.0:1788746444.237965:0:16580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:2.0:1788746444.237988:0:16580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a624fde4-21fb-41bf-be92-748365f2b29a+10:2350:x1875636141552000:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:2.0:1788746444.238032:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.238049:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746444.238054:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746444.238061:0:16580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.238075:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746444.304748:0:15039:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1788746444.304756:0:15039:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788746444.304769:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304783:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304792:0:15039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304800:0:15039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441478200 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746444.304805:0:15039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304814:0:15039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304850:0:15039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.304858:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009836e4b3/0xe59b64da5b30afd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.304948:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+14:2349:x1875636141551744:12345-192.168.206.24@tcp:4:dd.0 Request processed in 73140us (73415us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788746444.304962:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 0 00000100:00100000:0.0:1788746444.305015:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:0.0:1788746444.305027:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+13:2349:x1875636141551872:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:0.0:1788746444.305055:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.305067:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746444.305071:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746444.305076:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.305088:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746444.305437:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788746444.305451:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788746444.353715:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1788746444.353938:0:16580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788746444.353954:0:16580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.353965:0:16580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.353986:0:16580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.353994:0:16580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f44c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746444.354008:0:16580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.354016:0:16580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.354036:0:16580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.354286:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fba58f3/0xe59b64da5b30afdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.354364:0:16580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a624fde4-21fb-41bf-be92-748365f2b29a+9:2350:x1875636141552000:12345-192.168.206.24@tcp:4:dd.0 Request processed in 116377us (122775us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788746444.354377:0:16580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 1 00000100:00100000:1.0:1788746444.366475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.366527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.366557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:1.0:1788746444.366581:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746444.366729:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552128 00000100:00100000:3.0:1788746444.366739:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552128 00000100:00100000:3.0:1788746444.366788:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552256 00000100:00100000:3.0:1788746444.366791:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552256 00000100:00100000:3.0:1788746444.366805:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552512 00000100:00100000:3.0:1788746444.366807:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552512 00000100:00100000:3.0:1788746444.366817:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552640 00000100:00100000:3.0:1788746444.366819:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552640 00000100:00100000:3.0:1788746444.366914:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:3.0:1788746444.366924:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a624fde4-21fb-41bf-be92-748365f2b29a+12:2349:x1875636141552128:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:3.0:1788746444.366959:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.366988:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.366994:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.367010:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.367025:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746444.369308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.24@tcp (source: 12345-192.168.206.24@tcp) 00000100:00100000:3.0:1788746444.369430:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788746444.369440:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788746444.377969:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636141552384 00000100:00100000:2.0:1788746444.377984:0:15040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636141552384 00000100:00100000:3.0:1788746444.383894:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:3.0:1788746444.383913:0:16582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a624fde4-21fb-41bf-be92-748365f2b29a+14:2349:x1875636141552256:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:3.0:1788746444.383953:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.383980:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.383985:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746444.383993:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.384017:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746444.407630:0:15039:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:0.0:1788746444.407639:0:15039:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788746444.407653:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407667:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407676:0:15039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407683:0:15039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09ae00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746444.407688:0:15039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407697:0:15039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407715:0:15039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407722:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0726710/0xe59b64da5b30afe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.407853:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+18:2349:x1875636141551872:12345-192.168.206.24@tcp:4:dd.0 Request processed in 102825us (171284us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788746444.407863:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 2 00000100:00100000:0.0:1788746444.407905:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 5 00000100:00100000:0.0:1788746444.407915:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd344b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+17:2348:x1875636141552512:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:0.0:1788746444.407947:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407959:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746444.407963:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746444.407981:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.407993:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746444.408089:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:0.0:1788746444.454335:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1788746444.454988:0:16582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:1.0:1788746444.454994:0:16582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1788746444.455019:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455031:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455040:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455046:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440030a00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746444.455050:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455058:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455076:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455083:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ccd6fc/0xe59b64da5b30aff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746444.455181:0:16582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a624fde4-21fb-41bf-be92-748365f2b29a+13:2349:x1875636141552256:12345-192.168.206.24@tcp:4:dd.0 Request processed in 71270us (88649us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788746444.455191:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 4 00000100:00100000:1.0:1788746444.455221:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 6 00000100:00100000:1.0:1788746444.455233:0:16582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a624fde4-21fb-41bf-be92-748365f2b29a+12:2348:x1875636141552640:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:1.0:1788746444.455265:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455278:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746444.455282:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746444.455289:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.455301:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455714:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455724:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455730:0:15041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455736:0:15041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd440031800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:2.0:1788746444.455740:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455747:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455759:0:15041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455766:0:15041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa9ffcb0/0xe59b64da5b30afea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746444.455803:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a624fde4-21fb-41bf-be92-748365f2b29a+12:2349:x1875636141552128:12345-192.168.206.24@tcp:4:dd.0 Request processed in 88880us (89337us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788746444.455816:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 3 00000100:00100000:2.0:1788746444.455833:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.24@tcp, seq: 7 00000100:00100000:2.0:1788746444.455840:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a624fde4-21fb-41bf-be92-748365f2b29a+11:2349:x1875636141552384:12345-192.168.206.24@tcp:4:dd.0 00010000:00010000:2.0:1788746444.455859:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455867:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746444.455870:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746444.455874:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746444.455884:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746444.486825:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1788746444.487085:0:15039:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788746444.487091:0:15039:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788746444.487104:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487116:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487125:0:15039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487141:0:15039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd44e09b800 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:1.0:1788746444.487146:0:15039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487155:0:15039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487173:0:15039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746444.487181:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088a9e63/0xe59b64da5b30aff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746444.487253:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd344b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a624fde4-21fb-41bf-be92-748365f2b29a+13:2348:x1875636141552512:12345-192.168.206.24@tcp:4:dd.0 Request processed in 79338us (120691us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788746444.487262:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 5 00000001:00080000:1.0:1788746444.515317:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1788746444.515334:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1788746444.515445:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1788746444.515460:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515472:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515481:0:15041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515488:0:15041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd448f45000 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:3.0:1788746444.515505:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515513:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515533:0:15041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746444.515539:0:15041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029866835/0xe59b64da5b30b006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746444.515622:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a624fde4-21fb-41bf-be92-748365f2b29a+7:2349:x1875636141552384:12345-192.168.206.24@tcp:4:dd.0 Request processed in 59779us (146317us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788746444.515632:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 7 00010000:00010000:0.0:1788746444.516664:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516678:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516686:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516692:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd441479c00 already unused, calling callback (ffffffffc152b8d0) 00010000:00010000:0.0:1788746444.516696:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516714:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516728:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746444.516735:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f19492a2/0xe59b64da5b30afff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746444.516835:0:16582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45f677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a624fde4-21fb-41bf-be92-748365f2b29a+5:2348:x1875636141552640:12345-192.168.206.24@tcp:4:dd.0 Request processed in 61605us (150251us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788746444.516844:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.24@tcp, seq: 6 00010000:00010000:2.0:1788746445.242625:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788746445.901596:0:16619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788746446.268799:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746446.781594:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746446.781619:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163553664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746446.781686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746446.781758:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163553664 00000100:00100000:2.0:1788746446.781766:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163553664 00000100:00100000:2.0:1788746446.781827:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746446.781836:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163553664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746446.781867:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788746446.781910:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875636163553664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746446.781917:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788746446.781944:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746446.781968:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788746446.781984:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd45f79aa00, transno 8589934595 00000004:00080000:2.0:1788746446.782004:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788746446.782028:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875636163553664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746446.782644:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163554048:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782684:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746446.782700:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163553920:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782708:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746446.782713:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163554176:0@lo:400:kworker.0 00000100:00100000:2.0:1788746446.782731:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746446.782737:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746446.782749:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788746446.782755:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163553792:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782764:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163554048 00000100:00100000:3.0:1788746446.782769:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163554048 00000100:00100000:2.0:1788746446.782778:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746446.782795:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163554176 00000100:00100000:3.0:1788746446.782798:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163554176 00000100:00100000:2.0:1788746446.782809:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cd477b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163554304:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782819:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746446.782825:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163554048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746446.782829:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746446.782846:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163553920 00000100:00100000:2.0:1788746446.782849:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163553920 00000100:00100000:3.0:1788746446.782873:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875636163554048:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746446.782875:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746446.782881:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788746446.782882:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163553920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782893:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163554304 00000100:00100000:3.0:1788746446.782896:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163554304 00000100:00100000:3.0:1788746446.782911:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746446.782912:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875636163553920:12345-0@lo:400:kworker.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746446.782916:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd477b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163554176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746446.782918:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746446.782942:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd477b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875636163554176:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746446.782945:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875636163553920:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.782947:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788746446.782958:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746446.782963:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd45fb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163554304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.783006:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd45fb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875636163554304:12345-0@lo:400:kworker.0 Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746446.783012:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788746446.783029:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746446.783033:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746446.783049:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875636163554176:0@lo:400:kworker.0 00000100:00100000:3.0:1788746446.783057:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875636163554048:0@lo:400:kworker.0 00000100:00100000:2.0:1788746446.783110:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875636163554304:0@lo:400:kworker.0 00000100:00100000:1.0:1788746446.783125:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636163553792 00000100:00100000:1.0:1788746446.783129:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636163553792 00000100:00100000:1.0:1788746446.783164:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788746446.783170:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd44e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3317:x1875636163553792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746446.783214:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd44e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ea63f15-cd19-459c-bd52-18aa65dbbcba+19:3317:x1875636163553792:12345-0@lo:400:kworker.0 Request processed in 44us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746446.783232:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788746446.783659:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cd477b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ea63f15-cd19-459c-bd52-18aa65dbbcba:3317:1875636163553792:0@lo:400:kworker.0 00010000:00010000:2.0:1788746447.292283:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29389 lines, 29389 kept, 0 dropped, 0 bad.